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Abstract 

This paper deals with the modeling and control of a 
hybrid production unit based on renewable energies 
comprising two sources: wind/solar and hydrogen storage 
system. These subsystems have different voltage-current 
characteristics and consequently are integrated with static 
converters on a DC bus by using a suitable control 
system. This DC bus is coupled to a load or grid through 
a static inverter. Each production source is provided by a 
regulator ensuring the Maximum Power Point Tracking 
(MPPT). The control strategy of the studied Hybrid 
Renewable Energy Source (HRES) is decomposed into 
two parts: a local control depending on the power 
structure and a global control deduced from global 
considerations. This strategy leads to achieve power 
objectives (active and reactive power targets) and system 
constraints. 

Keywords: Wind turbine, Photovoltaic, Fuel cell, 

Electrolyser, Hybrid, Control, Simulation. 

1. Introduction 

The ever increasing demand for electrical power has 
created many challenges for the energy industry, which 
can affect the quality of the generated power in short and 
long terms [1]. In the developed countries, such as the 
United States or the European Union, the wind power 
was the fastest-growing energy in this last decade, thanks 
to its economy more and more attractive, its substantial 
environmental advantages, and the encouraging energy 
policies. In the same way, in the countries in the process 
of development, the wind power (in combination with 
other types of renewable energies) can play a more 
substantial role spectacularly to improve the quality of 
the human life in the immediate future [2]. 

The integrated Wind Energy Conversion System (WECS) 
and Photovoltaic (PV) array system, based on long-term 
seasonal energy storage as electrolytic hydrogen, is 
considered a promising alternative to overcome the 
intermittence of the Renewable Energy (RE) sources. In 
comparison to commonly used battery storage, hydrogen 
is well suited for seasonal storage applications because its 
inherent high mass energy density leakage from the 



storage tank is insignificant and it is easy to install 
anywhere [3-5]. 

In this international context expanding, search in the field 
of new technologies of the conversion systems of wind 
power and of hybrid systems requires a crucial effort. 
Indeed, hybrid wind/PV power generation systems have 
been studied extensively. Energy storage is needed in 
these systems due to the intermittent nature of wind and 
solar energy. Traditionally, deep-cycle lead acid batteries 
have been used as the means of energy storage. However, 
there are environmental concerns associated with the use 
of batteries; thus other alternatives are sought for this 
application. Fuel cells (FC) in combination with an 
electrolyser (EL) for hydrogen generation and hydrogen 
(H2) storage tanks have been considered for energy 
storage and implemented [6,7]. 

The remainder of the paper is organized as follows: 
Section (2) focuses on the description of the studied 
HRES. Section (3) emphasizes on the modeling of each 
component of the HRES and the FC/EL system. Section 
(4) describes the control strategies of the HRES. The 
control strategy of the studied HRES is decomposed into 
two parts: a local control depending on the power 
structure and a global control deduced from global 
considerations. According to the wind speed, the 
irradiation level and the load power, the global control 
part generates the adequate input references of the FC 
and of the EL. Section (5) presents the simulation results 
and section (6) gives the conclusion. 

2. System description 

The studied Hybrid Renewable Energy Source (HRES) 
consists of a 4 kW WECS and 1 kW (peak) PV array as 
primary energy sources. The excess energy with respect 
to the load requirement has been stored as electrolytic 
hydrogen through an electrolyser (3.6 kW) splitting water 
into hydrogen (H2) and oxygen (02), a gas storage unit 
(4 Nm 3 of H2 and 2 Nm 3 of 02) and a PEMFC (4 kW) to 
generate electricity during low wind speed and sun shine 
periods. The studied HRES in this paper is represented in 
figure 1 . The wind subsystem consists of a wind turbine 
driving a multi-pole Permanent Magnetic Synchronous 
Generator (PMSG) and of a AC/DC rectifier to connect 
this wind generator to the DC bus. The converter controls 
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the output voltages of the PMSG and indirectly the 
operating point of the wind turbine and consequently its 
generated power. The PV subsystem made up of several 
panels is connected to the DC bus via a filter and a 
DC/DC converter which controls the operating point of 
the panels and therefore the generated power. The DC 
bus collects the energy generated by the RE sources and 
supplies it through a converter DC/ AC and a filter to a 
load or to the grid. 

3. Modeling of the HRES 

In this section, the model of each system component is 
presented as if there was no interaction between these 
elements. With the help of the results of this modeling, 
the next section will then be devoted to the building of 
the Energetic Macroscopic Representation (EMR). 

3.1. Modeling of the WECS 

The aerodynamic power at the rotor of the turbine is 
given by the following equation: 

P = X -pkR 2 ^C p (1) 

where: p (kg.m" 3 ) is the air density, R (m) is the length of 
the blade, 3 (m.s -1 ) is the wind speed and C p is the 

power coefficient. This coefficient represents the 
aerodynamic efficiency of the turbine and depends on 
specific speed X and the pitch angle /? [8]. 

The mechanical system is represented by the following 
equation: 

J ^- = T m -T em -f Q (2) 

at 



the rotor speed and / (N.m. s. rad" 1 ) is a viscous friction 
coefficient. 

The model generally used of the PMSG is the Park model. 
By considering only the fundamental harmonic of the 
flux distribution in the air-gap of the machine and by 
neglecting the homopolar component, the theory of the 
space vector gives the dynamic equations of the stator 
currents as follows: 

^=j-(v sd - R J sd + p ^ L q I sq ) 

< dl 1 , \ ( ' 3 ' ) 

-£-=y( v « ~ r ° ^- pQL “ C 

with: R s is the phase resistance of the stator winding 
(Q), L d and L q are the d-q stator inductances 
respectively (H), ® m is the flux of the permanent 
magnetic (Wb), V sd and V sq are the d-q components of 
the stator voltages respectively (V), I sd and I are the 

d-q components of the stator currents respectively (A) 
and p is the number of pairs of poles. 

The electromagnetic torque is given by: 

T em=P (®* 4 , + i L d ~ L q ) I sd I sq ) ( 4 ) 

3.2. Modeling of the PV panel 

The electric power generated by a photovoltaic panel is 
unstable according to the irradiation level and the 
temperature. The characteristic of a photovoltaic cell 
describing the relation between the current I pv and the 

voltage V is given by [9]: 



Wind turbine 




Figure 1 : Configuration of the studied hybrid generation system 
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where J (kg.m 2 ) is the total inertia which appears on the 
shaft of the generator, T m (N.m) is the mechanical torque, 

T em (N.m) is the electromagnetic torque, Q (rad.s -1 ) is 
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with: I is the generated current under a given 
illumination (A), I sat is the current of opposite saturation 
of the diode (A), V t is the thermal potential (V), R ss is 
the equivalent series resistance of the photovoltaic panel 
(Q) and R sh is the equivalent parallel resistance of the 
photovoltaic panel (Q). 



3.3. Modeling of the hydrogen system 

In terms of fuel cell steady-state performance modeling, 
many electrical models have been developed either from 
a theoretical point of view or from an empirical point of 
view. The model used in this article is from the empirical 
point of view approach. This model enables to simulate 
both fuel cells and electrolysers V-j curves (cell voltage 
versus current density) in typical conditions. This model 
is particularly adapted to regenerative fuel cell (RFC) 
simulation. It is a four degree-of-freedom model and it is 
convergent near zero current. It depends on the stack 
temperature and the oxygen partial pressure [10]. 



3.3.1. Electrical model 

The curve of the cell potential V cell versus the current 



density J has an inflexion point for J-J d and at this 
point, the slope of the tangent is noted - A ; it is the sum 



of activation and resistive losses. This characteristic is 
given by the following equation: 



Ke U =E + 



W i '- 2 



4 



J 



( 6 ) 



where: E is the open circuit voltage (for J - 0 ), 

b is a parameter of the model. 

The four parameters E , J d , b and A have to be 
determined, fitting the modeling curve to the 
experimental data. These parameters depend on the cell 
temperature and on the oxygen partial pressure. The 
influence of the hydrogen partial pressure can be 
neglected as long as the hydrogen fraction on the anodic 
FC side is superior to 20% [11]. Due to the temperature 
and pressure dependence of the thermo chemical 
potential and the Butler Volmer equation, the influence 
of T and P 02 on the four parameters has the following 



form: K X +K 2 T + K 3 T ln(P Q2 ) . Therefore, for each 
parameter, three constants have to be determined in order 
to describe the temperature and pressure dependence, so: 



~ E ' 
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Tln(P 02 ) 



(7) 



To do so, a minimum of 16 data is required: four couples 
(J , V C eii) f° r f° ur P a i rs {Pq2’T} where P 02 and T must 



be at least at two different levels. The curves of the cell 
potential versus the current density of the FC and the EL 
are shown in figure 2, respectively. 





Figure 2: FC and EL V-j curves 

3.3.2. Thermal model 

To estimate the temperature evolution during operation, 
we use the following equation: 
dO 

C p ~P th ~ $ ext ~ (/> ech ~ (/> gaz ( 8 ) 

e =r-T a 

P th -±n c (U -U th ) I : thermal dissipative power 
fax! =h0 : heat flow lost in the atmosphere 
t gB =±(C p (H 2 )F(H 2 )+C p (H 2 )F(H 2 ))0: 
heat flow lost in gas 

(+ for the electrolyser, - for the fuel cell) 

where: C p thermal capacity of the device (J.K" 1 ), 

T temperature (K), T a ambient temperature (K), n c 
number of cells, U cell voltage (V), U lh thermo-neutral 
cell voltage (= 1 ,48 V) based on the higher heating value 
of hydrogen, / current (A), h heat transfer coefficient 
(W.K" 1 ), (j) ech energy flow lost in a heat exchanger (W.K" 1 ), 
C p(i) molar heat capacity of the gas i (Enrol -1 . K" 1 ) and 
F( i ) molar flow of the gas i (mol.s -1 ). 

3.3.3. Pressure model 

The gas management module enables to calculate gas 
production or consumption and the periphery pressure 
level during operation. To obtain the gas production or 
consumption, the two next equations are used: 

F** =^>h (FL);F =^2-L (FC) ( 9 ) 

nF nF rj F 

with: F gaz gas consumption for the FC and gas 
production for the EL (mol.s -1 ), ?j F faraday efficiency 
(%), F faraday constant (96485 C.mol -1 ) and n number 
of moles of electrons transferred per mole of water (n = 2 
for H 2 , n = 4 for 0 2 ). 

3.4. Modeling of power electronics 

The modeling of the converters is made by using the 
concept of instantaneous average value [12]. Indeed, this 
type of modeling is interesting since it adapts well to a 
numerical integration so it is not necessary to choose a 
step of integration lower than the period of operation of 
the converters. Moreover, it makes it possible to simulate 
the total dynamic behaviour of the system. 

A switching function f.. is defined for each power 

switch [12]. It represents the ideal commutation orders 
and takes the values 1 when the switch is closed (on) and 
0 when it is opened (off): 



( 10 ) 
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with 



\i €= {1,2,3} no. of the leg 
[j'e {1,2} no. of the switch in the leg 

As ideal power switches are considered, the switches of a 
same leg are in complementary states: 

+ fa = 1. 6 {1,2,3} (11) 

For both three-phase converters, rectifier ‘rec’ and 
inverter ‘mv’ of figure 1, modulation functions can be 
defined from the switching functions: 

7 ,,' 
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( 12 ) 



The rectifier provides the voltages V sdq = [ V sd V sq ] 

from the capacitor voltage U and the modulated 
current I wind , which is the first current element of the 



HRES from the PMSG currents / 



sdq 



= [4 



V sdq = m n 



u 



= mL / 



(13) 

L wind ' ' ''rec * sdq 

The three-phase inverter is modelled in the same way. It 
yields the inverter voltages V invdq = \V imd V invq J from 



the capacitor voltage and the inverter modulated current 
from the line currents = [/„ I,f : 



V. 



inv dq 



Idq 

™ inv u 



I I inv ^ inv ^ I dq 



(14) 



The purpose of the following section is the building of 
the Energetic Macroscopic Representation (EMR). In an 
EMP graph, each component of the system is 
characterized by its inputs and outputs, which may be 
scalars or vectors. Indeed, outputs are actions, which 
generate reactions, inputs of the model. The 
mathematical product of an input and associated output 
must be a power. As an example, the synchronous 
machine, excited by permanent magnets, produces 
electromotive forces acting on inductive circuits, which 
consequently react by generating currents. 



Control of the WECS. The WECS includes the wind 
turbine, the PMSG and the rectifier (see figure 3). This 
rectifier makes it possible to control the PMSG flux and 
consequently the speed of the generator. Block MPPT 
wind provides the value I sqref corresponding to the value 

of the reference electromagnetic torque. In this study, the 
vector control strategy applied to the PMSG, which 
consists in imposing a reference of the forward current 
I sdref to zero, is applied [13]. 




Figure 3: Energetic Macroscopic Representation of the WECS 



From the wind speed 3 , an artificial neural networks 
made up of radial basis functions computes the pitch 
angle /? and the optimal aerodynamic torque T mref . This 

computation is based on the mechanical characteristics of 
the wind turbine. The optimal torque gives the q-axis 
reference current I sqref . The d- and q-axis reference 

currents applied to two PI regulators and two decoupling 
stages give the d- and q-axis reference voltages V sdref and 

V sqref . These voltages applied to two modulators provide 

the switching functions of the rectifier which gives the 
modulated current I wind . The control strategy of the 
WECS, previously described, is illustrated in figure 4. 




4. Control strategies of the HRES 

The control strategy of the HRES can be decomposed 
into two parts: a local control depending on the power 
structure and a global control deduced from global 
considerations. The local part ensures an efficient energy 
management of each component of the system. The local 
control structure can be deduced from the Energetic 
Macroscopic Representation (EMR). The global control 
part is independent of the power structure. This strategy 
part leads to achieve power objectives (active and 
reactive power targets) and system constraints [13]. 

4.1 Local control of the HRES components 

The controllers considered are of Proportional-Integral 
(PI) types, which adjust a reference value to an actual one. 



Control of the PV. The PV source includes in addition to 
the panel, a filter and a converter ‘Chopper 1’ (see figure 
5). This DC/DC converter, of which the reference value 
V pvref is calculated by MPPT solar block, allows 

adapting the voltage of the panel to that of the DC bus. 



PV 




Figure 5: Energetic Macroscopic Representation of the PV 
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Various MPPT algorithms have been described in the 
literature. A good MPPT technique should produce a 
high efficiency at a low cost because PV systems will 
have to be mass-produced. In this work, the perturbation 
and observation technique [14,15] is used because it is 
simple, it requires only measurements of V pv and I pv , and 

it is capable of tracking the maximum power point. 

From the PV voltage reference V pvref given by the MPPT 

solar block, the chopper 1 adapts this voltage to that of 
the DC bus and provides the modulated 
current I pvm which is the second current element of the 

HRES. 

Control of the hydrogen system . The hydrogen source 
includes a PEMFC, an electrolyser and two choppers (see 
figure 6). These DC/DC converters adapt the voltages of 
the PEMFC and the electrolyser to that of the DC bus. 
The power management block gives the reference 
currents of the two converters while basing itself on the 
power management fixed by the global control strategy. 




Figure 6: Energetic Macroscopic Representation 
of the hydrogen system 

Taking into account the wind speed (wind power); the 
irradiance level (solar power) and the load power demand, 
the block power management generates the adequate 
values of the fuel cell current reference I fcref and of the 

electrolyser I fcref and so the on-times a fc and a el of 
the two corresponding converters. 



Control of the continuous bus and of the inverter . The 
DC bus constitutes the central element of the entire 
production unit and plays the role of a decoupling 
interface between the various components (see figure 7). 
The DC bus voltage is governed by the following 
differential equation: 

c d f = r rem -r, v (15) 

at 

where: C represents the capacitance of the DC bus and 
I rem is the total current of the HRES as shown in figure 7. 



The two sources (WECS, PV) and the hydrogen system 
are connected to the DC bus and then to the load or to the 
system power via the inverter and a line (see figure 8). 
This converter makes it possible to control the continuous 
voltage and the active and reactive powers exchanged 



with the grid and to establish the currents at the adequate 
frequency co s =100 nrad.s~ x . 




Figure 7: Energetic Macroscopic Representation of the DC bus 




Figure 8: Energetic Macroscopic Representation of the load/grid part 



In order to generate and send a current to the grid/load, 
the DC bus voltage ‘U’ has to be higher than the peak 
value of the voltage (phase to phase) appearing on the 

side of the filter. So U > V6 , where V ms is the rms 
value of the simple voltage appearing side of the filter. 
Since V ms -127 V , we have imposed U ref = 400 V . 

The control block permits the regulation of the DC 
voltage and the control of the reactive power and so the 
control of the inverter. We have chosen the unity power 
factor strategy i.e. the reactive power is set to zero 
( Qref = 0 ) with sinusoidal absorption. From the voltage 

reference U ref and taking into account of the DC bus 

power and the copper losses in the line, we obtain the 
active power reference P ref . The reference powers give 

the d- and q-axis reference currents I ldref and I lqref . These 

d- and q-axis reference currents applied to two PI 
regulators and two decoupling stages yield the d- and q- 
axis reference voltages V invdref and V invqref . These 

voltages applied to two modulators provide the switching 
functions of the inverter which gives the modulated 
current I inv . The control strategy of the DC bus and the 
inverter, previously described, is illustrated in figure 9. 

4.2 Global control of the HRES 

The wind turbine and the PV panels are the main power 
sources of the plant. The electrolyser is powered as long 
as the available renewable power is greater than the 
electric load demand. When the hydrogen storage tank is 
full, the electrolyser is not powered. The excessive power 
that could be produced in this event is transmitted to the 
power system. The fuel cell is operated when there is a 
requirement for power, and hydrogen is available from 
storage. 

The supervising system controls the overall current flow 
taking into account of the power supplied by the 
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renewable sources, the energy demands of the load and 
the hydrogen system following the flow chart of figure 
10 . 



respectively. The results of the global controller are 
shown in figure 25. This figure represents the reference 
FC and EL currents, which are very correlated to the 




Figure 9: Control of the DC bus and the inverter 




Figure 10: Flow chart of the global control strategy 



5. Simulation process and results 

Figure 1 1 shows the wind speed ranging between 8 and 
13 m/s with an average value of 10 m/s. This sequence is 
obtained by adding a turbulent component to a slowly 
varying signal. Figure 12 gives the photovoltaic 
irradiance level of the panels whose average value is 
around 800 W/m 2 . 

The simulation results of the studied HRES are 
summarized in figures 13-25. Figures 13 and 14 present 
wind and photovoltaic powers respectively. It is easy to 
check that wind speed and irradiance level are very 
correlated to wind and PV powers respectively. The 
ANN block gives the reference mechanical torque (figure 
1 5) according to the MPPT algorithm and the pitch angle 
(figure 16). For technological reasons, the regulator has 
to provide a lower pitch angle of 12°. In this simulation, 
we supposed that the load asks for a power of 3 kW 
between 0 and 100 s, then 5 kW between 100 and 200 s 
and finally 4 kW for the remainder simulation time. The 
curve of the load power demand is depicted in figure 17. 
The voltage of DC bus is represented in figure 18, which 
demonstrates that this voltage is perfectly constant, and 
thus proves the effectiveness of the established regulators. 
Figures 19 and 20 show the generated power and the 
consumed powers of the fuel cell and the electrolyser 
respectively. The temperature curves of the FC and the 
EL are depicted in figures 21 and 22 respectively. These 
figures prove that the two temperatures evolve in an 
acceptable band. Figures 23 and 24 represent the H2 and 
02 consumed by the FC and produced by the EL 



generated FC power and the consumed EL power 
represented in figures 19 and 20, respectively. 





Figure 12: Irradiance level 
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Figure 13: Wind power 




Figure 14: PV power 




Figure 15: Reference mechanical torque 





Figure 17: Load power demand 
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Figure 18: DC bus voltage 




Figure 19: Generated FC power 




Figure 20: Consumed EL power 
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Figure 21: Fuel cell temperature 




Figure 22: Electrolyser temperature 




Figure 23: H2 and 02 consumption 




Figure 24: H2 and 02 production 




Figure 25: Results of the global controller 

6. Conclusion 

In this paper we treated the problem of the modeling and 
the supervision of a hybrid production unit containing 
renewable energy sources. The WECS was modelled 
using d-q rotor reference frame. These renewable energy 
sources were interfaced with the power system through 
an inverter and a line modelled in the power system 
reference frame. The control strategy of the studied 
Renewable Energy Hybrid Source (HRES) is 
decomposed into two parts, a local control depending on 
the power structure of each source and a global control 
deduced from global considerations and power objectives. 
The complete control device, playing the role of 
supervisor developed in this work, was qualified to 
control and coordinate the operation of the different 
subsets. The dynamics of the HRES with typical 
numerical values are plotted. The simulation results 
showed the effectiveness of the adopted control strategy. 
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Abstract 

A new method for the implementation of a sensorless 
direct flux oriented control of induction motor drives 
is proposed in this paper. As the induction motor 
is decoupled if the direct rotor flux is maintained 
constant and equal to the nominal flux value and 
the reverse rotor flux is to be fixed at zero value. It 
is well known that the rotor flux of the induction 
motor is unmeasured. To cope with this problem and 
the drawbacks of the sensors, a combination of two 
observers is used: a full order Luenberger observer 
to estimate the rotor flux and a model reference 
adapt at ive system (MRAS) observer for rotor speed 
estimation. With the help of the observed (d, q) axis 
components of the rotor flux, the direct rotor field 
orientation vector control is implemented. We show 
by an extensive simulation study that the proposed 
method for DRFOC is completely satisfactory at 
low speed region and in field weakening region (high 
speeds). It is not sensitive to disturbances and 
parameters mismatch. Observers and control scheme 
are robust to changes in load torque. The method 
proposed achieves good performances with an optimal 
and adaptative gain tuning matrix obtained from the 
Linear Quadratic Regulator (LQR) design principle. 
Digital simulation results are presented to show 
the improvements in performance of the proposed 
method and the global stability of the MRAS based 
speed sensorless combined to flux observer scheme 
with the LQR matrix gain. 

Keywords: Induction motor, Direct rotor field 
oriented control, Luenberger Observer, MRAS and 
speed sensorless. 

1 Introduction 

Induction motor (IM) can produce good performance 
using field oriented vector control strategy. The main 



idea of the vector control is the control of the torque 
and the flux separately. In order to decouple the vec- 
tors and realize the decoupled control most control 
schemes require accurate flux and motor rotor speed. 
These informations are mainly provided by Hall sen- 
sors and sensing coils (flux measurement) and incre- 
mental encoder (rotor speed measurement). The use 
of these sensors implies more electronics, high cost, 
and lower reliability, difficulty in mounting in some 
cases such as motor drives in harsh environnement 
and high speed drives, increase in weight, increase 
in size and increase electrical susceptibility [1]. To 
overcome these problems, in recent years, the elim- 
ination of these sensors has been considered as an 
attractive prospect. The rotor velocity and flux are 
estimated from machine terminals proprieties such as 
stator currents or voltages as Extended Kalman Fil- 
ter and Artificial Neural Network. All these methods 
are complex. The complexities in these algorithms 
impose a very high computation burden [4]. More- 
over, the estimated speed error will give rise to flux 
error and this flux error will finally result in failures in 
the flux field oriented control strategy. For the field 
oriented control, we have two methods; the first is 
named indirect rotor field oriented control (IRFOC). 
While the second is named direct rotor flux oriented 
control (DRFOC). The DRFOC is based on the reg- 
ulation of the d and q axis rotor flux and addition of 
the opposite of the decoupling terms [13]. Based on 
the means of the decoupling machine, we propose a 
method to realize the direct rotor flux oriented con- 
trol without adding the decoupled terms. The princi- 
ple of this idea is to regulate the flux components so 
that the d axis rotor flux is equal to the rated rotor 
flux and the q axis rotor flux to be fixed to zero. The 
error between the observed d-axis rotor fluxes from 
its reference value (the rated value) feeds the propor- 
tional plus integral (PI) controller to obtain the direct 
stator voltage (vds). The error between the observed 
q-axis rotor flux and its reference value feeds the pro- 
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portional plus integral (PI) controller to obtain the 
reverse stator voltage (vqs) . The synchronous angular 
frequency is obtained from the output of the propor- 
tional and integral (PI) controller used in speed con- 
trol loop. In this method if a decoupling error occurs 
the flux controllers must cancel this error. Therefore, 
in this paper, we propose a flux observer based on the 
Luenberger observer with adaptive and optimal choice 
of a matrix gain [19] and [20] so that the exact flux es- 
timation is achieved. An MRAS observer [21] is used 
to estimate the rotor speed. Based on the observed 
flux and rotor speed, the direct rotor flux orientation 
is realized. Computer simulation results demonstrate 
that the proposed observation has excellent features 
at both steady and dynamic states and is robust to 
external disturbances. The efficiency of the direct ori- 
ented control method is illustrated in the simulation 
results in the steady and dynamic states and also at 
low speeds [10] and in the field weakening region. The 
observability and the stability of the observer are also 
studied and proved in this paper. 

The paper is organized as follows in the second sec- 
tion, we give a description of induction motor model. 
The observability of the system is discussed in the 
third section. The fourth section describes the adap- 
tative full order Luenberger rotor flux observer. The 
stability analysis is discussed in the fifth section. The 
sixth section studies the field oriented control. In the 
seventh section, we describe the design of a direct ro- 
tor flux oriented control. The last section deals with 
the simulation results and discussion. The paper is 
ended by a conclusion about the proposed method and 
perspectives. 
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i/ 3 s ] T is the stator currents vector, 
V( 3 S ] T is the stator voltage vector, 
<fip r ] T is the rotor flux vector, 



r s is the stator resistance, r r is the rotor resis- 
tance, L s is the stator self inductance, L r is the rotor 
self inductance, M is the mutual inductance, a is the 
leakage inductance, and uj is the rotor speed . The 
electromagnetic torque developed by the motor is ex- 
pressed in terms of rotor flux and stator currents as: 



T e =p*< 



(2) 



While the load torque acts as a disturbance via the 
mechanical relation: 



( 3 ) 

Where J is the moment of inertia of the rotor, p is the 
pole pairs and Tl is the load torque. 



2 Induction motor model 

Assuming linear magnetic circuits, equal mutual in- 
ductances and neglecting iron losses, the dynamic 
equations of induction motor in the stationnary refer- 
ence frame are formulated as: 



3 Observability study 

The observability of the system can be investigated 
using the observability matrix defined as: 

M 0 =[C CA CA 2 CA 3 ] T (4) 
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The system is observable if the rank of the observabil- 
ity matrix is equal to the number of states [2]. The 
observability is checked for various angular speeds of 
the rotor ( from -314 rad/s to +314 rad/s) and refer- 
ence frame. It is verified by computation that for each 
work speed value, the rank is maintained constant and 
equal to four as the number of states, indicating that 
the system is observable. 



4 Adaptative full order Luen- 
berger rotor flux observer 
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The adaptative full order observer for estimating the 
stator current and the rotor flux using the measured 
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currents and the measured stator voltages is described 
by the following set of equations: 







B i 

B 2 



v s + Le{t), 



A 12 
^22 



k y{t) = Cx{t). 




(5) 



Where , " , denotes the estimated values. L is the 
feedback gain matrix of the Luenberger observer. It 
is determined in order to ensure the observer stability. 



The first step is to drive an equation governing 
the state estimation error. Subtracting the induction 
motor model (1) from the observed motor model 
given by (5), we get the differential equation gov- 
erning the state estimation error. The characteristic 
model matrix depends on rotor speed. Therefore, the 
matrix A can be written as A + A A. Replacing A 
with its value, we obtain: 

^A = [A-LC]e(t)-AAx(t), (6) 



Where AA is the model mismatch error. It is defined 
as: 



AA = A(w) - A(c5), (7) 



By subtracting the characteristic model matrix from 
the observed one, we obtain: 

AA = DAcj , (8) 



In which, the matrix D is defined as: 



Dn D 12 

D 2 i D 2 2 



(9) 



Where, 

Du = D‘ 2 \ = O2, D12 = J, 

(J - LJ g ±Jrp 



D22 = J , 



As Du and D 2 i are equal to zero matrix value, which 
denotes that A A is independent of i s , based on this 
comment, the final form of the non linear block is 
defined by: 



W = F0 r Alo. (12) 



Where F is defined as: 

F=[ Jf (13) 

Equation (10) denotes that the estimation error is a 
combination of a linear dynamic fed forward with a 
non linear element. In order to maintain the stability 
of the complete system, the linear element must be 
stable and the non linear element have to converge to 
zero or to a minimal energy quantity which is given 
by the popov’s integral inequality [12]. Therefore, 
the matrix gain L is chosen so that the poles of the 
characteristic matrix A-LC is stable. The traditional 
way of doing this is described in [2] and [16]. It 
is based on the fact that the gain matrix can be 
analytically computed so that the observer poles are 
proportional to the motor poles, thus assuming the 
stability. For general rules, the observer poles have 
to be chosen 5 to 6 times faster than the motor poles 
[2], [11] and [15]. In this way, it is difficult to obtain 
accurate speed estimation due to variation of IM 
model characteristic matrix with the rotor speed. 
To cope with this problem and obtain an accurate 
speed estimation at both high speeds and low speeds, 
we propose an adaptative and optimal algorithm for 
computing the components of the Luenberger matrix 
gain. The adaptative and optimal algorithm is based 
on the well known LQR design principle in order 
to design varying matrix gain so that fast conver- 
gence and accurate speed and flux estimation can be 
realized. The LQR design principle is stated as follow: 

oo 

I m = 1 J (X t QX + U t RU) dt, (14) 

0 

Where Q is positive semi definite and R is positive 
definite. The optimal linear state feedback gain K is: 

K = -R~ 1 B t P. (15) 



and Auj = uj — a). 

The state estimation error can be simplified as: 

^A = [A-LC\e(t)-W (10) 



Which minimize the performance of the index / m . 
Here P is the solution of the algebric RICCATI 
equation defined as follows: 

PA + A t P - PBR~ 1 B t P + Q = 0. (16) 



Where W is the non linear block and is defined as: 

(ii) 



If we choose L = —R~ 1 B T P as a feedback gain of 
Luenberger observer, we ensure that the matrix A-LC 
is stable. 



W = DAux(t). 
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5 Stability analysis 

5.1 Stability of the linear element 

The linear element is represented by the matrix 
(A-LC). Its stability condition is guaranteed by the 
negativity of this matrix. 

lemma : 

A matrix H is definite negative if the determinant 
of their K th principal minors have the same sign of 

Remark: 

The K th principal minor of a square matrix(nxn) is a 
matrix (kxk) obtained by eliminating the lasted (n-k) 
lines and columns of the matrix. 

The determinants of the fourth principal minor 
are numerically computed for different operating 
angular speeds and reference frame. 

Fig. 1, 2, 3 and 4 show the evolution of the de- 
terminants of the different principal minors in the 
stationary frame. 

From these results, it is clear that the determinant 
of each K th principal minor have the same sign of 
(— l) fe , indicating that the matrix (A-LC) is strictly 
definite negative. Therefore, we conclude that using 
L = —R~ 1 B t P as a feedback gain of Luenberger 
observer ensure that the matrix (A-LC) is stable. 

The root loci of the full Luenberger observer in one 
hand and on the other hand the induction motor are 
represented in Fig. 5 and 6 respectively. 

These results show that the use of the new form of 
matrix gain ensure the rapidity of the observer poles. 
The rapidity rate is fixed by R and Q matrix index 
ponderation. 




Figure 1: The first order principle minor 




Figure 2: The second order principle minor 




Figure 3: The third order principle minor 




Figure 4: The fourth order principle minor 




14 




Automatic Control and System Engineering Journal, ISSN: 1687-4811, Volume 7, Issue 1, ICGST, Delaware, USA, May 2007 



300 



200 - 



I ° 

’ 51 ) 



-100 



- 200 - 



-180 -160 -140 -120 -100 -80 -60 -40 -20 0 

Real part 



Where: 7 is a finite positive constant, Ay is the 
output of linear block and Az is the output of non 
linear block. 

Consider the left hand size of the inequality (17), 
substituting for Ay and A z, we get: 



t 

f 



e T Wdt ^ —7, 



(18) 



By replacing W with its value, we obtain: 



1 

J e T F(j) r Aujdt ^ —7, 



(19) 



Figure 5: Full observer root loci for variable rotor 
speeds 




Figure 6: IM root loci for variable rotor speeds 



5.2 MRAS rotor speed observer 

The MRAS representation is given in Fig. 7. Ac- 
cording to MRAS method, we consider the motor as 
reference model and the observer as an adjustable 

model. The error between the states i s and i s is 
used to regulate the adaptative mechanism to adjust 
estimated speed Cj . To ensure the global stability 
of the observer, the non linear feedback block must 
converge to zero or to a minimal quantity of energy. 
Therefore, the system will be known as hyperstable. 
As defined in [3], the system is hyperstable if the 
forward path transfer matrix is strictly positive real, 
and the input , output of non linear feedback block 
satisfy popov’s inequality defined as: 



i 

/ 



AyAzdt ^ —7, 



(17) 



Schauder propose the following adaptative mecha- 
nism [17]: 

t 

Cj = Qi(e) + J Q 2 (e)dt , ( 20 ) 



(20) in (19) gives 



J e T F^ r 

0 



UJ — 



t 

Qi(e) - J Q 2 (e)dt 



> -7, (21) 



The solution of this inequality is given by the 
following expression: 



t 

/- 



df(t) 

dt 



f(t)dt ^ —1^/(0), (22) 



Where h is finite positive constant. Using (22) to 
resolve the popov inequality, we obtain: 



Q 1 = k p * e (gF0 r , 
Q2 = ki * 



(23) 



(23) in (20) yields 

Cj = k p * e + ki * J e(8)^ r dt. (24) 

Where Ki , K p are the integral and proportional con- 
stants. Here Ki and K p are considered as the weights 
multiplying the vectored product between current er- 
ror and estimated rotor flux and its integral respec- 
tively. Therefore, the tracking performance of the 
speed estimation and the sensivity to noise are de- 
pending on the proportional and integral gains. The 
integral gain Ki is chosen high for fast tracking of 
speed. While, a low proportional K p gain is needed 
to attenuate high frequency signals denoted noises [5] 
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and [6]. 




Figure 7: MRAS representation for rotor speed esti- 
mation 



6 Field oriented control 

One particular approach for the control of induction 
motor is the field oriented control (FOC) induced 
by Blaschke [18]. This control strategy is based on 
the orientation of the flux on the d axis [9] and [14], 
which can be expressed by considering: 

# 9) = [<^,0] t (25) 



+ Cyds 

(frqr H (s'j'Vqg T C V q S 
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Where r r , s, cj r and cj are the rotor time constant, 
the Laplace operator, the slip speed and synchronous 
speed respectively, 



a = uj r L r r r (r s + L s as ) (1 + r r s) — cu s , 



and 



b = —uj s ML r L s ai qs 



For the flux oriented control, we have two approaches. 
The first is known as indirect flux oriented control. 
While, the second is named as direct flux oriented con- 
trol. For the IRFOC, the rotor flux vector is aligned 
with d axis and setting the rotor flux to be constant 
and equal to the rated rotor flux. Based on these con- 
ditions, we establish the d and q axis voltage. While 
for the DRFOC, the d and q axis rotor flux must be 
known and they will be regulated so that the d axis 
rotor flux will be equal to the rated rotor flux and the 
q axis rotor flux will be equal to zero. The d and q 
axis rotor flux can be provided by the use of sensors or 
observers. Due to the drawbacks of the use of sensors, 
the d and q axis rotor flux are provided by the use of 
the Luenberger observer with an adaptative matrix 
gain. 

7 Design of direct rotor flux ori- 
ented control 

The direct rotor flux oriented control strategy consists 
on the regulation of the d and q axis rotor flux so that 
the rotor flux is aligned with the d axis [Fig. 8] Based 
on the dynamic induction motor model and the rotor 
winding linkages, we establish: 




Figure 8: Bloc diagram of the speed sensorless direct 
rotor field oriented control (DRFOC) 

It can be seen from (26) and (27) that it is possi- 
ble to control the d axis and q axis voltage separately 
if the coupled terms are equalled to zero. Here, these 
terms are considered as disturbances. Therefore, these 
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disturbances are canceled by the use of a PI controllers 
d for d and q axis rotor flux. The block diagram of 
PI controllers for d axis, q axis rotor flux and speed 
rotor is given in Fig. 8. Thus, the dynamics of the d 
axis and q axis voltage are now represented by simple 
linear second order differential equations. Therefore, 
it is possible to effectively regulate the flux with a PI 
controller. To assume perfect decoupled machine, the 
dynamics of the d axis and q axis must be equiva- 
lent in order to obtain the d axis flux equal to the 
rated rotor flux and the q axis flux equals to zero at 
the same time. The strategy adapted to specify the 
PI controller parameter is at first time to compensate 
the system zero on open loop. After that, we calculate 
the closed loop, we obtain a transfer function of the 
second order system. By fixing the desired closed loop 
dynamic, we find the appropriate parameters of the PI 
controllers [16]. In order to protect the system, an in- 
ner current loop was added. To validate the strategy, 
the proposed algorithm has been implemented in the 
Matlab environnement. 



8 Simulation results 

The dynamic behavior of the system was investigated 
by using computer simulations with Matlab/ Simulink 
software. We have tested the proposed method at 
variable speed, in the field weakening region and at 
zero speed command with load applied. 

The results obtained in the forward operation at vari- 
able step target speeds are represented in Fig. 9 to 12. 
It can be seen that the d axis rotor flux converges very 
quickly to the target, the q axis rotor flux is equal to 
zero, indicating that the decoupling is established in a 
very short time. Compared to the indirect rotor flux 
oriented control, we can not command the time of the 
decoupling machine. For the DRFOC, the decoupling 
time is controlled by the rotor d and q axis flux con- 
trollers. 

To investigate the efficiency of decoupling controllers 
and speed control system, a zero reference speed is 
studied. Fig. 13 to 16 show the simulation results 
with a zero reference speed by adding the load torque 
of 8 Nm at t=7s. It is shown in Fig. 13 that the d 
axis rotor flux converges to the rated rotor flux (1.1 
webers) and the q axis rotor flux has a zero value. By 
adding of the load torque, the d and q axis stator flux 
deviate from their reference values and due to the ex- 
istence of controllers, they converge quickly to their 
target values. 

Fig. 17 to 20 show the trapezoidal response in for- 
ward and reverse operation. In this test, both the field 
weakening operation and load torque disturbance are 
considered. It is noted that the ideal decoupling is 
established at a very short time. Hence, high speeds 
require rather large input voltages. In practice, the 
voltage must be kept within the inverter ceiling lim- 
its so that the flux is decreased from the rated as the 



speed increases above rated one. This method of re- 
ducing the flux at high speeds is called M field weaken- 
ing" [8], 

In different tests, as the load is applied, the d and q 
axis rotor flux deviate from their value and due to the 
controllers the deviation error is attenuated in time. 
From all these results, it is clearly proved that the 
speed sensorless IM drives proposed method for the 
direct rotor field oriented control gives good results 
under load disturbances. However, the quality of this 
method is related to the controller which must be ro- 
bust. 
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Figure 9: Real, observed and target d and q axis rotor 
flux at variable motor speed 




Figure 10: d and q axis rotor flux observation error at 
variable rotor speed 
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Figure 11: Real, observed and target rotor speed at 

variable speed operation Figure 14: d and q axis rotor flux observation error at 

zero speed command 





Figure 12: Rotor speed observation error at variable 
speed operation 



Figure 15: Real, observed and target rotor speed at 
zero speed command 
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Figure 13: Real, observed and target d and q axis 
rotor flux at zero speed command 



Figure 16: Rotor speed observation error at zero speed 
command 
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Figure 17: Real, observed and target d and q axis 
rotor flux at the field weakening region and reverse 
speed operation 




Figure 18: d and q axis rotor flux observation error at 
the field weakening region and reverse speed operation 

9 Conclusion 

A new method for direct rotor field oriented control, 
in low speed, zero speed and in held weakening re- 
gion, has been presented and verified by using exten- 
sive simulation work. The novelty and advantage of 
this method consists in decoupling used technique and 
observer matrix gain computation. The use of the con- 
trollers force the d-axis rotor flux to be constant and 
equal to the rated value and the q-axis rotor flux to be 
fixed at zero value. If the decoupling error occurs, it is 
canceled by the controller which justifies the efficiency 
of this method compared with the indirect rotor held 
oriented control where the decoupling of the machine 
is not controlled. The quality of this method is related 
to two conditions; hrstly, the accuracy and robustness 
of the observers and secondly the controllers which 
must be robust. Moreover, a stability analysis study 
is performed and justihed for the proposed speed sen- 




Figure 19: Real, observed and target rotor speed at 
the held weakening region and reverse speed operation 




Figure 20: Rotor speed observation error at the held 
weakening region and reverse speed operation 

sorless induction motor drives. 

Practical implementation of the proposed method , at 
low and high speeds regions, are the subject of future 
followup research work. 
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Abstract 

In this paper, we present recent developments in ground 
surveillance and target tracking systems. Such systems 
posses various characteristics which include having the 
ability to strategically integrate information from several 
sources so as to make accurate decisions, optimizing the 
location of sensors to achieve complete coverage of the 
desired area and efficiently utilizing the resources of the 
system. Various techniques (including Evolutionary 
Algorithm) have been used to accomplish this. In 
addition, such systems posses intelligent agents, which 
are autonomous devices that have various sensors, and 
have the capability of processing and communicating 
information with other agents either directly or through a 
central processing system. 

Keywords — Autonomous Agents, Surveillance Systems, 
Evolutionary Algorithm, Distributed Network 

1. Introduction 

The design and development of surveillance systems is 
increasing, especially in military applications where there 
is a need for fast and accurate decision-making under a 
variety of complex situations. The main objective of 
these systems is to provide accurate detection and precise 
tracking of moving targets by integrating information 
from several sensors. In addition to that, these systems 
should also be capable of 1) optimizing the location of 
sensors in order to achieve complete coverage of the 
desired area; 2) efficient use of the system’s resources 
(e.g. maintenance of sensor’s battery life for a longer life- 
span); and 3) reliable real-time communication in the 
midst of harsh environmental conditions and/or changes 
in the system [1]. As a result of such a dynamic 
environment a lot of research has been done into the 
development of autonomous systems, capable of 
achieving the goals of surveillance (such as target 
detection, location and tracking etc) in the midst of 
constantly changing conditions. In addition, such systems 
have intelligent agents, which are autonomous devices 
comprised of various sensors (such as acoustic, infrared) 
and have the capability of processing and communicating 



information with other agents and with a central 
processing system. This paper presents a summary of 
research that has been undertaken with the intent of 
conquering the above-mentioned obstacles. The rest of 
this paper is organized as follows: Section 2 gives an 
overall description of agents; passive and active. 
Different coverage area optimization techniques are 
presented in section 3. In section 4, the power 
optimization techniques utilized in such sensor networks 
are described. Section 5 expounds on the communication 
aspect of the distributed collaboration scheme and section 
6 gives a summary and a conclusion. 

2. Agents 

Although the concept of a sensor network is not new 
(DARPA initiated the Distributed Sensor Networks 
program in 1980), recent advances in microprocessor 
fabrication has lead to a dramatic reduction in the size 
and power consumed by such devices. Battery and 
sensing technology together with radio hardware have 
also followed a similar minaturisation trend. The 
aggregation of these advances has lead to the 
development of networked, millimeter-scale, sensing 
devices capable of complex processing tasks. 
Collectively these form a Wireless Sensor Network 
(WSN), thus heralding new era for ubiquitous sensing 
technology. Large scale deployments of these networks 
have been used in many diverse fields such as wildlife 
habitat monitoring [2], traffic monitoring [3] and lighting 
control [4]. 

Due to the limited power supply of these devices, it is 
imperative that the operation of each node factor into 
account when making any decision to perform an action. 
For example, consider the case where a nodes power has 
depleted to a point where it is capable of only a handful 
of transmissions. The network should be able to adapt to 
this fact and this node should only transmit if it deems it 
critical to do so. This decision must be taken on a per- 
node-basis as off node deliberation would necessitate 
further transmissions. 

Intelligent and proactive behavior such as this is 
characteristic of an intelligent software agent. Agents 
form the basis for distributed, artificially intelligent 




21 





Automatic Control and System Engineering Journal, ISSN: 1687-4811, Volume 7, Issue 1, ICGST, Delaware, USA, May 2007 



applications [5], and their applicability to WSNs is the 
central theme of this paper. Making an informed decision 
by incorporating various perceptions or beliefs about an 
environment is at the very heart of an agents deliberative 
cycle. Goal oriented reasoning can allow the agent to 
commit to the course action that best realizes its goals, in 
this case the agents goal is to maximize the network life 
span. Its perceptions are the sensory modality or 
modalities it is capable of sensing and the remaining 
battery power. By reasoning about the effect of a 
transmission, the agent can see if that action best suits its 
goals, which in this sample instance is unlikely to be the 
case. 

Generally speaking there are two types of agents: passive 
and active. Passive agents are agents designed to solve 
well-defined problems by responding to situations with 
predefined actions; in other words, for every situation 
they face, they have well defined procedures of how to 
respond to these situations. There are different ways 
agents react to situations. A few examples include 
making reference to a lookup table of situation-action 
pairs or implementing a combinational logic circuit. The 
designer of the agent (or some Artificial Intelligent 
process embedded into the agent) usually determines 
these actions for the majority of situations that could 
occur. As a result, such systems require very little effort 
in computation but have very large memory. Passive (or 
reactive agents) operate well in environments that do not 
change very much. On the other hand, these agents have 
very fast response-time, since their response has already 
been predetermined. Some examples of these types of 
agents include patient diagnosis agents and certain kinds 
of data-mining agents [6] and [7]. 

Intelligent agents are information-based systems that 
perceive their environment, via interfacing with their 
physical world using sensors, or a collection of other 
agents, or other complex environments. Intelligent agents 
also have the capability to interpret perceptions, draw 
inferences, solve problems and determine actions. They 
can also act upon that environment to realize a set of 
goals or tasks for which they are designed. Intelligent 
agents interact with a human or some other agent via 
some kind of agent-communication language [8]. If 
needed, these agents are able to adapt to their 
environment in order to realize their goals. These agents 
have the capacity to learn new things (from past 
experiences and current precepts), which enables them to 
evolve into smarter machines and make more accurate 
decisions. There are 3 primary types of intelligent agents: 
reasoning, learning and evolving agents [9]. Reasoning 
agents have the ability to make inferences by following a 
chain of predefined rules, and can be proactive in their 
use of reasoning. On the other hand, learning agents are 
not only able to follow a set of rules, but also improve 
their responses by learning from their experiences. One 
means is by programming them to weight their decisions. 
Lastly, agents that evolve with each successive 
generation are termed evolving agents. Here, knowledge 
acquired or learned can be passed from agent to its 
offspring. The most common of these three are the 
learning agents. 

A theoretical example that shows the difference between 
intelligent and passive agents is a mail-sorting system of 



a manufacturing company. The passive agent system 
would be designed to place each department’s mail in 
their mailboxes, while mail not directly linked with any 
department would be placed in the “unknown” mailbox, 
to be sorted out by a person. On the other hand, the 
intelligent agent would be designed not only to distribute 
the mail, but also to figure out the destination of the 
ambiguous mail. Ambiguous mail is mail that could have 
vague or inaccurate origin, name of the person to whom 
it is sent, destination, etc. In addition, as the intelligent 
agent system learns the destination of the ambiguous mail, 
it stores this newly acquired knowledge. Common 
techniques used for learning in intelligent agents are 
Neural Networks, Bayesian Rules, Credit Assignments 
and Classifier Rules. Through learning, these agents are 
better able to adapt to their environments. Adaptation is 
behavior of an agent in response to unexpected events or 
dynamic environments. Examples of unexpected events 
include the unscheduled failure of an agent, an agent's 
computational platform, or underlying information 
sources. Examples of dynamic environments include the 
occurrence of events that are expected but it is not known 
when, events whose importance fluctuates widely (e.g., 
price information on a stock), the appearance of new 
information sources and agents, and finally underlying 
environmental uncertainty (e.g., not knowing beforehand 
precisely how long it will take to answer a particular 
query). [10] 

Adaptation is achieved through first establishing a proper 
symbolic representation of the environment. These 
symbolic representations are produced by the timely 
interpretation of the environment through feedback from 
perception processes. The work presented by Diehl et al. 
[11] is an example that illustrates part of this; it presents 
the initial steps taken towards the ultimate goal of 
developing a distributed surveillance system that 
produces a timely interpretation of the environment 
through feedback from perception processes. The main 
component of the system presented by Diehl et al. [11] is 
the CyberARIES, which is an agent-based software 
architecture responsible for the coordination of sensing, 
processing and communication among the agents, and the 
development of efficient perception algorithms for 
detection and classification. The CyberARIES 
architecture consists of two main parts: the agent and the 
distribution layer. The agent is able to communicate with 
other agents (through its source and sink), which is 
controlled by an agent run loop, Figure 1. The 
distribution layer is the communications infrastructure 
that manages the flow of stimuli amongst agents and 
within the system. It also determines which agents should 
assist another agent during perception. 

The efficient perception algorithm consists of a motion 
detection algorithm that quickly acquires a model of the 
environment while being insensitive to jitter caused by 
vibration. First, constructing a background model that 
continuously changes and subtracting this 
image from each frame to obtain the foreground image, 
which in turn is used to segment each target, achieves the 
motion detection. The background model is constructed 
using an Auto Regressive (AR) filter applied to the 
current frame and a time-lagged frame. In addition, the 
motion detection algorithm classified moving objects 
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Figure 1. Communication between agents, by Diehl et al. (1999) 

either as people (single or multiple), vehicles or unknown 
objects. This classification was carried out using the 
difference image, rather than the threshold difference 
image, since the former provided a more stable 
representation of the object image without influence from 
the background. 

Another example of an agent system that implements 
symbolic representation is presented by J. Orwell et al. 
[12]. It consists of an architecture that implements a 
scene-understanding algorithm in the visual arts domain. 
This architecture consists of multiple cameras and an 
agent framework (where each camera has its own agent). 
These agents are responsible for tracking the events in 
their field of view, which is accomplished by performing 
the following tasks: 

□ a planar homograph is maintained between a three 
dimensional (3D) image plane and the ground plane; 

□ a model of the appearance of the scene is learned and 
continuously updated; 

□ an Object Agent is invoked for each stable tracked 
event; 

□ and lastly, 3D positional and color data supplied by 
the scene model are integrated within the tracker, 
which is then transferred to the object agent. 

The main objective of the tracker is to associate 
moving objects between frames by first classifying pixels 
as either moving or not moving. Next, these moving 
regions are then recovered and interpreted. Finally, a 
temporal continuity of the moving regions is matched. In 
addition, the task of the object agent is to describe the 
appearance, motion and activity of the event within the 
ground plane. The object agent utilizes the 3D color and 
positional data (being the pixel data and computed 
location) of the event to accomplish this. This results in 
an approximation of the trajectory and color of the 3D 
event, and a classification of this event based on a set of 
pre- stored activities. Periodically, each invoked object 
agent communicates with the other (by sharing trajectory 
and color data). If two object agents have similar data 
(indicating that their cameras are viewing the same 
event), both agents are combined to form one agent; this 
new agent then inherits the camera data link of both 
cameras and its (the new object agent’s) trajectory and 
color data are updated from both sources. 

Piaggio et al. [13] present a unique way of representing 
the world in terms of the radial distance between objects 
in the world and the agent. Here, real-time sensor data 
acquisition and representation of the world and its usage 
for real-time navigation is proposed. Figure 2 is a block 
representation of the system’s architecture. The Perceiver 
and the Motion Controller are interrupt-driven processes 
that connect the robot to the real world through a virtual 
interface. The former receives its information through 
ultrasonic sensors located around the robot’s body, while 



the motion controller is responsible for the robot’s 
motion, through the robot’s actuators. 

The three message-driven processes, the Map Handler, 
the Artificial Potential Field (APF) Handler and the 
Navigator, operate simultaneously under a more relaxed 
time constraint and are, to a large extent, machine 
independent; the first two develop and update an internal 
representation of the world, while the third alters the 
parameters that control the robot’s motion, based on this 
internal representation. 

For a more efficient APF representation, two map 
representations are formed. The first is the ecocentric 
representation (mentioned earlier) while the second is the 
robocentric representation. As a clarification from the 
authors, the latter shows the radial distances of objects 
from the robot that were generated during navigation. 
The APF is a graph built from this robocentric 
representation; it (the APF) characterizes obstacles as 
regions of high-energy and it works directly with the 
navigator to coordinate the robots motion. 

The authors’ view is as shown in Figure 2. There are two 
main processes: interrupt driven (software or hardware) 
and message driven (software). The former does not 
require any special communication scheme, while the 
latter operates when certain conditions are met, which 
depend on a message broadcasting protocol. In addition, 
the message driven processes send messages that are 
grouped according to their content, in order to indicate 
that an action/computation has occurred or is required by 
the sender, or to indicate the type of message it will 
receive. 

Representations 




As a further clarification by the authors, an advantage of 
this second function is the conservation of the CPU’s 
resources, i.e. processes are suspended until the required 
message is received. 

Gesu et al. [14] present a system which illustrates the 
means of adaptation through perception and symbolic 
representation. They present the design of a Distributed 
Architecture System for Autonomous Robot Navigation 
(ARN) utilizing Genetic Algorithm (GA). The 
architecture presented is based on three modules that are 
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implemented on separate and interacting agents (the 
target recognizer, the obstacle evaluator and the planner). 
In addition, an adaptive form of GA is used to identify 
mechanisms for reaching the target and for manipulating 
the two directions of the robot. Data about the 
environment is collected through a video camera placed 
on the head of the robot, and two infrared sensors on the 
bottom of the robot. Information from the video is used 
to recognize the target, while evaluation of distances 
from obstacles is carried out with information received 
through the sensors. The first two agents within the ARN 
system (the Target Recognizer and the Obstacle 
Evaluator ) are dedicated to the evaluation of the sensors 
information, while the third agent (the planner) plans the 
robot’s movements according to an optimization strategy. 
Moreover, additional modules are used (in conjunction 
with the three main modules) to handle Input/Output (I/O) 
and evaluate the robot’s movements (see Figure 3). 

The author suggests that more attention should be paid 
to the evolution of data by mentioning that the system’s 
evolution is based on an Active Information Fusion (AIF) 
loop that consists of five modules ( Observe , Evaluation, 
Optimization, Choose-Next , and Action - Figure 4) that 
could be implemented in parallel. Their responsibilities 
are stated below: 

□ Observe: acquires and preprocesses sensorial data; 

□ Evaluation: computes the robot’s next choice of action 
based on the observed parameters and its current state. 
The evaluation makes use of the Optimization module 
(which implements Genetic Algorithm); 

□ Choose-Next: selects the new movement (or 
Action) of the robot on the basis of the 
Evaluation module. 

Once the Action has been executed, further sensor- 
explorations are undertaken. 




Figure 3. The Agents of the Distributed Architecture System for 
Autonomous Robot Navigation. 



According to the authors, the planning agent is 
responsible for driving the robot toward the target. Its 
aim is to “. ..find the minimum number of steps [required] 
to reach the target in position (x T , yf starting from the 
position (x 0 , y 0 ) and avoiding obstacles in the room ...”. 
Assuming there is one rectangular obstacle present, 
Figure 5, then the navigation problem can be formulated 
as a dynamic programming problem (Equations 4 
through 7), where the variables in the equations represent 
the coordinates of the robots (x i? yf the coordinates of 
the top-left comer of the obstacle (x ob , y ob ), the 
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Figure 4. The Active Information Fusion Loop of the Distributed 
Architecture System for Autonomous Robot Navigation. 



coordinates of the target (x T , y T ) and the angle between 
the direction of the robot displacement and the vector 
robot- target (0), Figure 5. Sx, Sy and Se describe the 
dynamic evolution of the system and 8 measures the 
length of the path made by the robot to reach the target in 
step units. Although the robot has no knowledge of the 
coordinate system, it is able to navigate through the 
evaluation of distances from the obstacles and the 
direction of the target with respect to its displacement 



direction. 

Xi = S x (0i_i, Xu, y M , x ob , y ob , x F , y T ; a, P) (1) 

yi = S y (0i_i, xu, yu, x ob , y ob , x F , y T ; a, P) (2) 

0i = S 6 (0u, xu, yu, x ob , y ob , x F , y T ; a, P) (3) 

min(5(x 0 , y 0 , x T , y T )) (4) 
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Figure 5. The Robot-Target Assessment. 




The planner (responsible for providing 0 and the speed of 
the robot) incorporates the GA that was designed to 
approximate a solution to the navigation problem 
mentioned previously. This GA: 

□ selects a starting population of 200 genomes (e.g. 
"1010101111010111”; each genome represents the 
displacement directions, a, in the interval [~n,n] (see 
Figure 6). They are mapped in 16-bits word using 



the function: R(a) = 



(« + ; r)(2 15 -1) 

2 7T 



( 5 ) 



□ performs a uniform-probability single-point 
crossover operation on randomly chosen 
genomes; 

□ performs a one-bit mutation, with 
probability rate of 0.01; 

□ determines the fitness (F b;k ) for each pair of 
chromosomes; and 

□ selects a new population using the 
tournament technique), and terminated if 
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the global fitness, F, satisfies the 
convergence criteria. 




Direction of 
Target 



Direction of 
Displacement 



Figure 6. The direction of the displacement (with respect to the target). 



The fitness function is defined based on a formulation 
that considers obstacles and target as electric objects, 
which generate electrostatic fields (the target attracts and 
obstacles repel): 

Fitness = (a * F target ) - (P * F obstacles), with a + P = 1 

( 6 ) 

• Ftarget = K * (it - 0), is a linear decreasing function of 

e, 

• K is a positive constant experimentally determined, 
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is a function of the 



measurements from the range detectors, R i? 

• Q's is a constant that depends on the directions of the 
infrared sensors, which are computed during the 
calibration phase. 

Another multi-target tracking system is presented [15]. In 
this system, a video is used to track the movement of 
people as they enter and leave a bus. In order to track a 
moving/stopped target, each frame produced by the video 
camera is divided into hexagonal cells, with the aim of 
assigning a group of cells to one target. Each pixel in a 
frame is assigned to a cell. If the intensity of a pixel is 
greater than a certain threshold, it is considered to be on 
and each cell is considered active if the number of “on” 
pixels in the cell is above 40%. Once a group of cells are 
formed (which are either in direct or indirect contact with 
one another) they are considered to be an estimation of 
the position of the target, only if they satisfy certain rules 
- this group of cells is termed a blob. In addition, the 
author mentions that if two blobs are close to one another 
(where they actually touch each other), the entire group 
of cells undergoes a series of tests in order to identify the 
group as two separate blobs, and as such, two separate 
targets. 



3. Coverage Area Optimization 

Another area of autonomous surveillance agents that is 
very critical is the optimization of the location of sensors 
in order to maximize the area covered by these sensors, 
while accurately tracking targets. A great deal of research 
has been conducted into achieving this goal with the help 
of Evolutionary Algorithms e.g. GA and Neural 
Networks; one example is presented by Buczak [16]. In 
this work, the author suggests that new ways for the 
collection and treatment of sensor information should be 
applied. The author introduces a novel method, which 



utilizes GA to determine the optimal combination of 
sensors (with minimal network power consumption and 
best location accuracy) that can detect and/or locate 
targets. It was discovered that one sensor triplet is needed 
per target, and sensors used for different targets can be 
shared. Within this system, a network of randomly 
distributed unattended ground sensors perform Self- 
Organization (SO) based on the Mission Statement (MS). 
The commander (or the central control system) issues the 
MS, which defines the goal of the surveillance, the 
geographical area and target types. The SO results in the 
translation of the MS into a Network Objective (NO) that 
defines what sensors should be used to perform the 
current objective at each point in time, and as events 
happen in the environment, the SO adapts the NO. The 
NO Adaptation (NO A) and Optimization modules 
(modules of the NO) are responsible for carrying out 
these functions. More specifically, the NOA module is 
responsible for the automatic generation of the 
optimization problem based on the MS and the events 
that happen in the environment, and starting the tracking 
with the sensors chosen by the Optimization module. 

The author also suggests that more attention should be 
allocated with GA data and processes. Since GA is used to 
obtain an optimum solution, each solution (or chromosome) 
is an m-tuple of sensors that can be used to track a given 
target. Assuming we have k targets, where n sensors can 
detect each target, then the number of tuples per target is 
given by equation (7) and the search space is given by 
equation (8) 



#M -Tuples = 01 = 



n\ 

( n-m)!-m! 



(7) 



k 

SearchSpace = ( NumberOfMT uples ) 



( 8 ) 



Each chromosome contains the identification of the 
sensors (or genes) that are chosen to be active at a given 
moment (i.e. to track the target). The number of genes 
per chromosome varies with the NO. For the fitness 
function, it depends on the location accuracy and the 
network power consumption. It has the following form: 

k i 

Fitness = -( u, • ^ E. + w 2 • ^ Pj ) (9) 

i = 1 j = 1 

where E t (i=l,2,...,n) is the estimated position error for 

the z'-th target, Pj (j=l,2, , m) is the power consumption 

of the y'-th sensor, k is the number of targets, / is the total 
number of selected sensors and wj/w 2 are two weight 
constants. The implementation of the GA was carried 
through the GeneHunter ™ Dynamic Link Library of basic 
GA functions, which was linked to the authors C/C++ 
program. In addition, the authors used an elitist GA with 
a constant probability of one-point crossover set at 0.9 
(per gene) and a constant probability of mutation set at 
0.01 (per bit). With the number of individuals in the 
population constant, the GA was run until there was no 
improvement in the best individual of the population. 
Another unique area of research that utilizes GA to 
optimize coverage area [16] focuses on merging trackers 
that track the same object, in order to reduce redundancy 
as well as increase the accuracy of tracking. In other 
words, trackers (which consist of 2 or 3 sensors that can 
track an object) are created, merged, separated and 
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removed so that each target is properly tracked and 
redundant trackers are avoided. A few sensors are placed 
along the perimeter of the area under surveillance, and 
they are turned and left on. When one of these perimeter 
sensors detects an object, a tracker and its database are 
created (which is based on the amount of sensors that can 
and do detect the object). In addition, each tracker has to 
be updated with the help of a GA (i.e., sensors are 
replaced if they are unable to detect the target), while 
trackers with sensors that are tracking the same target are 
merged/fused (i.e., their database). Figure 7 shows a 
basic example of fusing two trackers’ database: 



DBA Fused Targets TAI 






1 


2 


w 


3 


4 



A-l 




B-l 


A-2 


B-2 




B-3 



Figure 7. Basic example of fusing two trackers. 



In the example shown in Figure 7, the database of 
Tracker A (DB A) and the database of Tracker B (DB B) 
are fused. Within database A, two targets are registered 
and associated with two tracks (A-l and A-2) while three 
targets are registered and associated by three tracks (B-l, 
B-2 and B-3) in database B. After the fusion process, 
only four (instead of five) targets are obtained. After 
comparisons, it was concluded that tracks A-2 and B-l 
are the same. 

[17] propose a Dynamic Coverage Maintenance (DCM) 
scheme that exploits the limited mobility of sensor nodes. 
Here, the main objective is to compensate the loss of 
coverage with minimum expenditure of energy. Four (4) 
DCM schemes are proposed which can be executed on 
individual sensor nodes having the knowledge of just the 
local neighborhood topology. These schemes determine 
which neighbors to migrate and to what distance, such 
that the energy expended is minimized and the coverage 
obtained for a given number of live nodes is maximized. 
The schemes and their responsibilities are described as 
follows: a) the Maximum Energy Based (MEB) scheme 
moves the node with maximum available energy; b) the 
MinMax Distance (MMD) scheme moves that neighbor 
which needs to cover minimum distance to achieve 
maximum compensation for the dead node’s coverage; c) 
the Minimum Distance/Energy (MDE) scheme considers 
the ratio between distance to be moved and energy 
available, and chooses the node with minimum ratio; and 
lastly, d) the Minimum Distance Lazy (MDL) scheme 
moves the least distance possible so that the coverage is 
maintained, unlike the first three which try to move as 
close to the dead node’s position as possible without 
affecting their existing coverage. The decision and 
movement is completely autonomous in the network and 
involves movement of one-hop neighbors of a dead 
sensor node. An extension to these algorithms is also 
proposed called Cascaded DCM, which extends the 



migrations to multiple hops, if the net migration distance 
is less than a single-hop migration. 

Additionally, Megerian et al. [18] consider another angle 
of sensor coverage area. They present best and worst- 
case formulations for isotropic sensor coverage in 
wireless sensor networks. As well, they proposed an 
optimal polynomial time algorithm that uses graph 
theoretic and computational geometry constructs for 
solving for best and worst-case coverage. The results 
they achieved from their experiments show potential at 
being applied in applications of the theoretic coverage 
formulations and algorithms specifically for solving for 
additional sensor deployment heuristics to improve 
coverage, worst-case coverage (Maximal Breach), best- 
case coverage (Maximal Support) and stochastic field 
coverage. 

4. Power Optimization Techniques 

Another unique area of interest within the study of 
surveillance systems is the investigation into techniques 
that optimize power resources. In [14], the authors 
present a system that implements a technique taking into 
consideration the power resources of the system. This 
system utilizes a wireless surveillance network and an 
algorithm that determines if a local node should be made 
active for the next snapshot/scan. Each node contains an 
autonomous node manager, which determines whether 
the node should be made active or not based on two 
factors: 1) the locations of the active nodes that were 
present in the last snapshot, and 2) the ability of the node 
to reduce the Root Mean Squared position error of the 
target, under low power constraints. 

In [19], Buczak presents another surveillance system, 
along with the use of a network of sensors, to 
automatically generate the optimization problem, which 
depends on the events happening in the environment, and 
utilize a GA generated specifically for the problem to 
find the quasi-optimal combination of sensors (i.e. 
sensors with minimized power consumption and accurate 
tracking) that can detect and/or locate targets. 

Bume, in [20] also presents a surveillance system 
designed to replace today’s military-used unattended 
ground sensors (UGSs), which have a rather large size (> 
1 ft 3 ) and are relatively expensive. The author states that 
the system will posses smaller and less costly sensors that 
will work cooperatively together as a network, under the 
supervision of an algorithm, in order to maximize its 
tracking accuracy and minimize its power utilization. 

So far, a general description of various 
schemes/architectures that utilize intelligent agents in the 
area of surveillance have been presented. Each has some 
form of organization where there is either a central 
processing system that processes information gathered by 
the agents and in-turn communicates its conclusions to 
these agents or the agents themselves possess the 
information-processing capability and communicate 
amongst themselves. The communication scheme 
adopted by the surveillance system depends on the 
objective of the entire system. The next section presents a 
definition of the different communication schemes 
implemented within surveillance systems and gives 
examples of schemes/architectures that implement each. 
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With the advent of ad hoc networks of geographically 
distributed sensors in remote site environments (e.g. 
sensors dropped from aircraft for personnel/vehicle 
surveillance), there is a focus on increasing the lifetimes 
of sensor nodes through power generation, power 
conservation, and power management. Current research 
is in designing small Microelectromechanical Systems 
(MEMS) Radio Frequency RF components for 
transceivers, including capacitors, inductors, etc. The 
limiting factor now is in fabricating micro-sized 
inductors. Another thrust is in designing MEMS power 
generators using technologies including solar, vibration 
(electromagnetic and electrostatic), thermal, etc. 

RF-ID (RF identification) devices are transponder 
microcircuits having an L-C tank circuit that stores power 
from received interrogation signals, and then uses that 
power to transmit a response. Passive tags have no 
onboard power source and limited onboard data storage, 
while active tags have a battery and up to 1Mb of data 
storage. RF-ID operates in a low frequency range of 
100kHz-1.5MHz or a high frequency range of 900 MHz- 
2.4GHz, which has an operating range up to 30m. RF-ID 
tags are very inexpensive, and are used in manufacturing 
and sales inventory control, container shipping control, 
etc. RF-ID tags are installed on water meters in some 
cities, allowing a metering vehicle to simply drive by and 
remotely read the current readings. They are also be used 
in automobiles for automatic toll collection. 

Meanwhile, software power management techniques can 
greatly decrease the power consumed by RF sensor nodes. 
TDMA is especially useful for power conservation, since 
a node can power down or ‘sleep’ between its assigned 
time slots, waking up in time to receive and transmit 
messages. The required transmission power increases as 
the square of the distance between source and destination. 
Therefore, multiple short message transmission hops 
require less power than one long hop. In fact, if the 

distance between source and destination is R , the power 

2 

required for single-hop transmission is proportional to R . 
If nodes between source and destination are taken 

advantage of to transmit n short hops instead, the power 

2 2 

required by each node is proportional to R M . This is a 
strong argument in favor of distributed networks with 
multiple nodes, i.e. nets of the mesh variety. 

A current topic of research is active power control, 
whereby each node cooperates with all other nodes in 
selecting its individual transmission power level [21]. 
This is a decentralized feedback control problem. 
Congestion is increased if any node uses too much power, 
but each node must select a large enough transmission 
range that the network remains connected. For n nodes 
randomly distributed in a disk, the network is 
asymptotically connected with probability one if the 
transmission range r of all nodes is selected. 

5. Communication Schemes 

The control of the activities of autonomous agents within 
a surveillance system is characterized into three schemes: 
the hierarchical scheme, the centralized scheme, and the 
distributed scheme. In the hierarchical scheme, there are 
several groups of agents and each group has one agent 



that controls the actions of the others. The centralized 
scheme is different; it has a single agent that coordinates 
the actions of the remaining agents. Within the 
distributed scheme, each agent independently controls 
itself. In addition, there are systems that utilize a 
combination of these three schemes. 

5.1. Hierarchical Scheme 

One system that implements this scheme is presented by 
Liu et al. [22]. The work presented here focuses on the 
optimal selection of perimeter sensors that will initially 
detect targets as they enter the region under surveillance. 
Once the target is detected, a Self Organization Module 
will select a set of sensors (at most 3 sensors that are 
capable of detecting the object), which will track the 
movement of this target. 

B. Horling et al. [23] present another target tracking 
system that implements the hierarchical collaboration 
scheme. Here, the environment is divided into a series of 
sectors (which are non-overlapping, identically-sized 
rectangles), the sensor agents are distributed amongst 
these sectors and within each sector, a sensor agent is 
chosen to be the sector manager - Figure 8. In addition, 
the remaining sensor agents (within each sector) are 
divided to assume the following roles: sensor data 
production; target detection and location; target tracking 
and sensor’s data processing. Once each sensor agent has 
determined the sector to which it belongs, it informs its 
sector manager of its capabilities and the sector manager 
negotiates with the sensor agent in order to organize the 
scanning of the region. Each sensor agent determines 
when its assigned tasks get performed and it can chose 
between which assignments it will undertake if received 
from more than one sector manager - Figure 9. Once an 
object has been detected, the sector manager picks one of 
the sensor agents as the track manager, who in turn 
selects a group of sensor agents to track the movement of 
the object - Figure 10. The data gathered from these 
sensors are then sent to another sensor agent who 
determines the current location of the object and develops 
the objects track, which is in turn used to estimate the 
direction in which the agent would move. This 
information is then given back to the track manager, and 
the whole process repeats itself - Figure 11. From the 
above-mentioned process of target detection, location and 
tracking, the hierarchical scheme is realized through two 
main steps: the first is through the distribution of the 
entire body of sensors into the divided sectors with the 
appointment of one sensor from each group as a sector 
manager, and the second is through the selection of a 
track manager (within each sector) following the 
detection of a target. 

S. Lazar et al. [24] present a unique method of mobile 
agent communication and location. Within their scheme, 
all mobile agents (small software objects capable of 
moving around a network and executing tasks) are 
considered to be the leaves of the tree-like hierarchy 
structure, and they are placed on an agent server (or agent 
runtime environment). In addition, each node within this 
network is considered a Domain Gateway Server (DGS - 
see Figure 12), and it holds the address of its parent node 
(except the root node) and the path registration entry for 
every agent within its group. This entry consists of the 
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agent’s unique identifier and a pointer to the next 
location where the agent was transferred (unless 
otherwise stated). 





Figure 9. Negotiation between sector managers and the sensors within 
each sector. 




Figure 10. The track manager chooses sensors that will track the 
movement of the object. 




Figure 1 1 . The location and track of the object are determined by the 
data received. 

5.2. Centralized Scheme 

As mentioned earlier, the centralized scheme consists of 
a Central Processing System that controls/coordinates the 
activities of the surveillance system. The work presented 
by B. Jung et al. [25] incorporates (to a large extent) the 
centralized scheme. This system undertakes the tracking 
of targets within a large structured, complex environment, 
e.g., an office environment containing numerous small 
rooms. There are two levels of control within this system. 
The first is the coarse level, where a Central Processing 
System distributes the agents into the regions that contain 
the targets (i.e., the entire environment is divided into 
simple regions by using landmarks as demarcaters). This 
distribution is based on the regions need of agents and the 
distance between the region being considered and the 
agents. The second level of control is amongst the agents 
themselves, i.e. in terms of tracking the targets. Here, 



each agent maintains a topological map of the region 
(which it receives from the Central Processing System) 
and any necessary information needed for tracking). 




Figure 12. The Domain Tree Network. 

Feller et al. [26] present another centralized system, 
which utilizes infrared sensors and high-resolution 
cameras to detect, locate, track and identify targets. This 
system consists of 22 binary infrared detectors that are 
commercially available over the Internet (for object 
tracking), a Merlin NIR Infrared Camera by Indigo 
Systems Corporation (for object identification), a PC 104 
Modular Computer with a Pentium Processor (as the 
central control node) and a display for the results. The 
Modular Computer and the Infrared Camera interact 
through a Netgear FVM318 802.11b Enhanced Wireless 
VPN Firewall Router, while data sent through the 
infrared detectors’ built-in transmitters is received by the 
serial port antennae of the Modular Computer. Within 
this system, a two-dimensional pixel map represents the 
environment under surveillance. When an object is 
detected, the pixel’s intensity, which corresponds to the 
field of view of the sensor that detected the object, is 
incremented. As such, pixels with higher intensities have 
a greater probability of specifying the location of the 
target and, in turn, are used to specify the angle that the 
infrared camera should turn. 

5.3. Distributed Scheme 

Soh et al. [27] present an agent system that utilizes the 
distributed scheme for agent communication or 
collaboration. The agents within this system each have 
time-bounded, limited resources allocated to them (with 
no centralized information shared), they are fully 
autonomous, and there is no hierarchical organization 
among them (which increases their autonomy). As a 
result, these agents have to 1) utilize their available 
resources to track targets (individually or as an alliance) 
that appears within their coverage area, and 2) share these 
resources and information pertinent to target tracking 
with other agents during negotiation sessions. The 3 main 
resources that make-up this system are: 9. 3 GHz Doppler 
Moving Target Indication MTI sensors, which 
communicate using 900MHz wireless RF transmitters 
over 8 channels (at any time-scan, one of three 120° 
swath sectors is available to each sensor); a network of 
CPU platforms, upon which sensor-controlling agents 
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reside; and the “tracker” - the software that calculates a 
probable location and velocity of the target. 

The agents within this system are reflective (they are 
conscious of the availability of their resources and the 
effect of their actions on these resources) and perform 
negotiation through a bottom-up approach of solution 
creation. In addition, they execute Case-Based Reasoning 
(CBR) thus allowing their negotiation to adapt to the 
changing environment. 

Hegazy et al. [28] present another system whose agents 
operate within a distributed scheme. The system contains 
mobile agents that must detect and track the movement of 
targets that enter the surveillance region (each target is 
assigned a value that determines its importance). 
Whenever an agent detects a target, it must interact 
(through broadcasting) with its neighboring agents to find 
out if the detected target is currently or was under 
surveillance; it then makes a decision on whether or not 
to track this object, based on the response it gets. 

Another system designed and presented by Bererton et al. 
in [29] implements a distributed collaboration scheme. 
The robots within this system (called CMU Milli-bots) 
are constructed at the 5- 10cm scale so as to allow them 
accessibility to tight areas. In addition each robot is 
equipped with customized modules based on the robots 
tasks (there are three modules: sensing, processing and 
mobility). As such, one robot might be equipped with a 
mobility module suited for coarse terrain, while another 
could be equipped with one suited for flat terrain. If 
desired, this would allow the system to partially 
incorporate the hierarchical collaboration scheme (where 
one robot can be equipped with a more powerful 
processor module that supervises the operations of a 
group of sensors). One very unique feature about this 
system is the ability of each robot to sense/detect objects 
in a variety of ways: in other words, each sensor can be 
mounted with multiple types of sensors such as an 
infrared proximity sensor, a sonar or a video camera. 
This is useful when an object positioned at a certain angle 
cannot be detected by a particular sensor (such as a 
sonar), but can be detected by another type of sensor 
(such as an infrared sensor). In addition, although 
information from a sonar sensor, for example, can be 
used to generate a 2D description of the environment, it 
is not sufficient enough to identify or distinguish between 
objects. So another sensor would need to be used at the 
same time. 

Similarly, research has been conducted in the area of 
space exploration: more specifically, exploring small 
bodies like asteroids and meteors. As explained by 
Udomkesmalee et al. [30], exploring such bodies will 
require small, low-cost spacecraft with autonomous 
landing capabilities, and due to the uncertainty of the 
surface of these bodies, remotely controlling this 
spacecraft from the earth will be impractical and 
ineffective. As a result, such spacecraft must contain 
autonomous agents, which will be responsible for landing 
the spacecraft safely. The autonomous design proposed 
by the authors utilizes The Gabor Filters [17] to identify 
planetary features, calculates the location of theses and 
then determines the right place to land the spacecraft 
(based on these locations). 



Distributed scheme consist of agents that possess the 
ability to operate independently. As a result, such agents 
should have a reliable communication scheme that will 
enable them to interact with other agents within their 
network. This section presents various schemes that have 
been developed. 

Kay et al. [31] give a very good example. Their system, 
which is called the ATL (Advanced Technology 
Laboratories) Postmaster System, is placed on every 
machine that an agent could visit and it coordinates the 
collaboration and information dissemination between the 
agent and the computer. This system was designed with 
the intent of reducing the costs acquired by the agents 
(such as duplicate requests sent to a particular server and 
duplicate data transmitted across low-bandwidth lines). 
There are three main features about the ATL Postmaster 
system, explained below: 

ATL Postmaster systems are able to automatically deliver 
data to the agent’s system (i.e., the system that placed the 
request) as specified by the agents, either periodically 
(updated or not) or as the updated versions are available; 
Since agents check-in with the Postmaster before and 
after working at a machine, the Postmaster is able to 
modify the agent’s itinerary, such as redirecting the agent 
to another machine where the information needed by the 
current agent is already cached (cheaper services) or 
piggyback data on the agent if headed in the right 
direction (cheaper communication). 

A Postmaster can act as a middleman in the sense of 
storing information to be used by other agents or relaying 
information to other Postmasters from agents. 

In addition, the Postmaster system is written in the Java 
language and is designed in a general way such that it 
could be applied to a variety of agents. 

In [32], Johnson presents another algorithm that 
discovers and maintains a communication route between 
two mobile agents; such an algorithm is designed to be 
used within an ad hoc network, e.g., amongst a collection 
of research scientists who have gathered in a hotel 
ballroom and wish to communicate with each other 
through PDAs (Personal Digital Assistant). If the source 
and receiving agents are within transmission range of 
each other, then discovering/setting up a route is a matter 
of transmitting requests and acknowledgments. On the 
other hand, if the receiving agent is not within 
transmitting range, then the source agent will broadcast 
this request to its neighboring agents. As each agent 
receives this request, it tags on its address to the request 
and then broadcasts it to its neighboring agents, until the 
receiving agent receives the request. The inclusion of the 
address serves two purposes: a) the route is specified, and 
b) the request is prevented from being broadcast twice by 
any agent. Upon receiving the request package, the target 
agent will return this route information back to the sender, 
using a similar method of broadcasting and address 
appending. In terms of route maintenance, an 
intermediate agent (or router) may request a confirmation 
from the next hop; if this is not received within a certain 
period of time, it can be assumed by the agent that the 
hop is faulty or has moved outside the transmission range. 
This agent can either inform the source agent about the 
situation (in order for the source agent to discover 
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another route) or the intermediate agent can discover 
another route that will originate from itself. 




Figure 13. Structure of a Routing Agent in MAR. 

Another type of communication protocol implemented 
within a distributed scheme is introduced by Zhou et al. 
[33]. This protocol (known as MAR - Mobile Agent 
Routing) employs mobile agents - packets that travel the 
network and collect routing information - in order to 
make this information available to every node within the 
network. More specifically, when these packets visit 
nodes, they update the node’s routing table with 
information about other nodes and retrieve information 
from this table, which was left by other packets. The 
structure of each packet is shown in Figure 13 and a 
description of each part of the packet is given as follows: 
Type: differentiates the mobile agents from other packets, 
ID: differentiates each agent from the other; 

Last node: stores the most recent node visited; 

Hist size: defines the size of Info map; 

Infomap: stores all gathered routing information; and 
Age: records the sequence of nodes visited. 

With the information stored within the routing table, each 
node would be able to determine what route to take in 
order to get data to a certain destination. In addition, 
Chen and Gerla [34] and [35] present another routing 
scheme with a design that has the routing accuracy of the 
Link State scheme [32] and the dissemination method of 
the Distributed Bellman-Ford (DBF) scheme [31]. This 
new scheme, called Global State Routing, consists of an 
ad-hoc network that is modeled as an undirected graph G 
= (V, E), with V as a set of nodes and E as the undirected 
links connecting each node within V. A list and three 
tables are maintained for each node i - a neighbor list A i? 
a Topology Table TT i? a next hop table NEXTi and a 
distance table D*. In addition, TTi contains entries for 
each destination node j; TTi.LS(j), the link state 
information reported by node j, and TTi.SEQ(j), the 
timestamp indicating the time node j generated the link 
state information. Lastly, a weight function (E -> Z 0 + ) is 
used to determine the distance of a link. Each node i 
considers its neighbors to be the nodes whose routing 
message packets are placed in its inbox queue. It updates 
its routing information (with the packets received) by 
comparing the sequence number of the packets received 
with those locally stored. It then rebuilds its routing table 
with this new information. This up-to-date information is 
then disseminated only to the neighboring nodes of node 
i, rather than flooding the entire network. 

Leu et al. [22] investigate mobile agent communication 
issues and propose a distributed sendbox approach based 
on a Session Initiation Protocol (SIP) as the signaling 
protocol, which offers two modes: a) a direct mode used 
when the receiving agent is stationary, and b) a forward 



mode used when the receiving agent is moving. Both 
modes are illustrated in Figures 14 and 15. 




Figure 14. Direct Mode of the Distributed Sendbox. Here, the location 
of the receiving agent (R) is identified (via a central station - H). 



In addition, a prototype was developed and the results of 
the experiments conducted followed their prediction, and 
at the same time illustrated the variation of 
communication time and utilization rates under different 
receiver’s moving frequencies. 




Figure 15. Forward Mode of the Distributed Sendbox Scheme. Here, 
the sending agent (S) buffers the message intended for the receiving 
agent (R) that is currently in motion. 



The selection of centralized vs. distributed architecture 
depends upon a number of factors, including the number 
of restraint devices, controller throughput requirements, 
package size, system cost and assembly considerations. 
In relatively simple mechanizations involving a small 
number of restraint devices and limited sensing and 
processing requirements, the centralized architecture may 
offer cost and assembly advantages. In relatively 
complex mechanizations involving a large number of 
restraint devices and sophisticated sensing and processing 
requirements, the distributed architecture may offer 
packaging and processing advantages. 

6. Conclusion 

Recent developments in surveillance systems have been 
presented in this paper. Such systems have the following 
capabilities (but are not limited to them): (1) strategically 
integrate information from several sources to make 
accurate surveillance decisions; (2) optimize the location 
of sensors to achieve complete coverage of the desired 
area; (3) efficiently use the resources of the system, and 
(4) reliably communicate in real-time in the midst of 
harsh environmental conditions and/or changes in the 
system. Various methods and techniques (including 
Evolutionary Algorithm) have been utilized to 
accomplish the above-mentioned capabilities of 
surveillance systems through the use of intelligent agents 
(which usually are autonomous devices that posses 
sensory and processing components). In addition, various 
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information communicating/processing techniques have 
been presented, with the main focus on a distributed 
communication scheme. 
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Abstract 

Fault detection and diagnosis (FDD) can be described as 
early determination (detection) and localization 
(diagnosis) of faulty elements in a dynamic system. In 
this paper, a model based approach to detect and 
diagnose abrupt and slowly varying faults in a three-tank 
benchmark system is developed. The Fault detection and 
diagnosis scheme is formulated as a state estimation 
problem by considering the fault parameter as an 
additional state. It is then solved as a simultaneous state 
and fault parameter estimation using Augmented State 
Kalman Filter (ASKF) and Two Stage Kalman Filter 
(TSKF). Extensive simulation studies performed on three 
tank bench mark system reveal that the FDD scheme is 
capable of generating reasonably accurate state and fault 
parameter estimates in the presence of process and 
measurement noises. This holds good for different types 
of faults. Further the performance of ASKF is compared 
with that of TSKF. 

Keywords: Augmented State Kalman Filter (ASKF), Two 
Stage Kalman Filter (TSKF), Fault Detection and 
Diagnosis (FDD), Three-Tank System. 

1. Introduction 

Fault detection and diagnosis for dynamic systems has 
gained more attention in the recent years mainly due to 
an increasing demand for better performance as well as 
higher safety and reliability standards (Isermann, [1] 
Basseville, [2] Frank, [3] Gertler,[4] Patton, [5]). Faults 
can occur either in the main processing equipments (leak 
in tanks, variation in process parameters like heat transfer 
coefficient etc.) or in the auxiliary equipments (bias/drift 
in sensors, actuators, controller outputs, stuck actuators 
and sensors). Faults such as stuck sensors and stuck 
actuators are classified as hard faults. In principle such 
faults occur less frequently and it is comparatively easy 
to detect using low and high alarm thresholds. On the 
other hand small biases in sensors, actuators and 
controller outputs are considered as soft faults and are not 
that much easy to detect. 

This paper is focused on detection and diagnosis of soft 
faults only. FDD methods can be broadly classified into 
model based methods and model free methods. Model 



free methods do not use mathematical model of the 
process, whereas model based methods make use of 
mathematical model of the process either in state space 
or in input-output form. The model based methods can 
be further classified as state estimation approach, and 
parameter estimation approach. State estimation provide 
reliable information on process state variables, they are 
classified in to linear state estimation, nonlinear state 
estimation and parameter estimation. Luenberger 
observer [6] is used for state estimation of deterministic 
linear dynamic systems. Extended Luenberger observer 
is the straight forward extension of Luenberger observer 
to nonlinear system. The parameter estimation method 
has significant engineering importance, because in many 
real world problems accurate values of physical system 
parameters are not known a priori for use in tasks such as 
control, monitoring or fault diagnosis. In fault diagnosis 
its application is to detect the onset of fault and to 
estimate the parameter drifts and/or abrupt changes in 
system parameters. Parameter estimation problem can be 
formulated as state estimation problem by considering 
the fault parameter of interest as additional state. 
Normally, the FDD task could be realized in two steps: 
(i) Residual generation (ii) Residual evaluation. Residual 
generation is the construction of signals that are 
accentuated by the changes in the parameters (faults). 
Residual evaluation is the decision and isolation of the 
occurrence of the changes in parameters (faults). In an 
ideal case, a residual generated will be zero if no faults 
are present, different from zero when fault is present 
Observer based approaches to fault detection are model 
dependent. Depending on the nature of the models used 
in the observer, they are classified. 

Luenberger observer (Luenberger [6]) uses the linear 
state space model of the system and it is used for state 
estimation of deterministic linear dynamic systems. A 
Fuzzy observer (Efran Alcorta [7]) uses the Takagi- 
Sugeno Fuzzy model of the system. A Neural observer 
(T.Marcu [8]) uses the ANN model of the system and a 
bilinear observer (L.EL.Bahir [9]) uses the bilinear 
system model. A non-linear observer uses the original 
non-linear equation of the system. Three Kalman Filters 
are run in parallel to estimate the angular velocity in 
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Gyroless Spacecraft [10]. 

In Kalman filter approach, state estimates are obtained 
using two distinct steps, a one step ahead prediction is 
obtained based on the latest state estimate and in the 
second step the state estimate is refined by linearly 
combining the state prediction obtained in the first step 
with a new output measurement. 

Traditional Kalman filter has been widely used only for 
state estimation of linear stochastic systems. In order to 
generate state estimates fault parameter estimates in the 
presence of fault and plant model mismatch, the state 
vector has been augmented with fault parameter as an 
additional state, accordingly the system matrices are 
augmented resulting which is an Augmented State 
Kalman Filter (ASKF) and solved as simultaneous state 
and fault parameter estimation problem. However this 
approach can lead to unacceptably large computational 
burden and numerical inaccuracy. To overcome the 
above difficulties, Friedland,[l 1], has shown that 
optimum state estimates can be expressed as output of the 
bias free filter based on non existence of the bias, 
corrected with output of the bias filter. This algorithm is 
called Two Stage Kalman Filter (TSKF). R.J. Patton, [5] 
has regarded three tank water process as a valuable 
experimental setup for investigating multivariable feed 
back control as well as fault diagnosis. For identifying 
components, sensor and actuator faults in three tank 
bench mark system various fault diagnosis schemes such 
as Neural observer [8], Generalized Likelihood Ratio 
based FDI[9], Fuzzy observer [7], Multiple model based 
approach[12], Non-linear observer[13] have been 
demonstrated. 

The existing FDD schemes are capable of handling only 
single fault (either component or sensor or actuator). If 
multiple faults occur simultaneously these methods 
cannot work satisfactorily. Further they are working in 
the principle of residual generation and residual 
evaluation. Residual generation is finding the difference 
between process and model output. Residual evaluation is 
comparing the residual with threshold, and threshold is 
the difference between process output in the presence of 
noise and model output when no fault is present. Hence 
the existing methods cannot estimate the fault when their 
magnitude is less than noise present in the system. The 
proposed methods are capable of estimating the faults 
even their magnitude is very small as compared to the 
noise present in the system and the number of faults that 
can be estimated is equal to the number of estimated 
states. The paper is organized as follows: The fault 
detection and diagnosis scheme is described in section 2, 
the detailed simulation results are presented in section 3 
and section 4 provides the conclusion drawn from the 
simulation results. 

2. Fault Detection and Diagnosis Scheme 

Let us assume that the process is described by the 
following linear time invariant state space model as, 

x(k+i) = 0 x(k) + r u u(k) + r w w(k) (i) 

Y(k) = CX(k) + V(k) (2) 



Where X(k) e R n state vector, U(k) e R m the known 
deterministic inputs and y(k) e R r the measured outputs. 
W(k) and V(k) represents state and measurement noises. 
It is further assumed that W(k) and V(k) are zero mean 
normally distributed and mutually uncorrelated white 
noise sequences with covariances, 

E [ Wi(k) Wj(k) T ] = Q 5 y 



E [ Vj (k) Vj(k) T ] = R 5 ij with Q > 0; R > 0 
Where 5y is the Kronecker delta and E denotes the 
expectation operator. The linear time- invariant matrices 
<D, r u , r w and C are obtained from the first principles 
model of the process after performing linearization and 
discretization operations. In the absence of fault, the 
process evolves as given in equations (1) and (2). 

A fault f(k) due to step change in process parameter, or 
actuator bias is modeled using the following state 
evolution equation, 

x(k+i) = 0 x(k) + r u u(k) + r w w(k) + r f e f4 f(k) (3) 

Where T f represents coupling matrix and e^ is a unit 
vector indicating the index of the variable. The matrix T f 
for different faults are obtained from first principle 
models. 

A fault due to sensor bias(r s ) is modeled by modifying 
the measurement equation (2) 

Y(k) = CX(k) + V(k) + r s e f;i f(k) (4) 



In the presence of fault the process evolves according to 
equations (3) and (4). It is also assumed that the process 
evolves according to an augmented state space model 
after combining equations (3) and (4) as follows: 

x(k+ 1 ) = ox(k) + r u u(k) + r w w(k) + r f f(k) (5) 
f(k+l) = f(k) (6) 

Y(k) = CX(k) + V(k) + r s f(k) (7) 



X a (k) = 



Defining an augmented state vector as 

^ 'x(k)' 

_f(k) _ 

Equations (5), (6), and (7) can be rewritten as 

x a (k+i) = o a x a (k) + r ua u(k) + r wa w a (k) 



Y(k) = C a X a (k) + V(k) 
From these equations, 

"O r f 



0a= 



0 I 



r 



L u 
0 



r 

wa 



c a = [c r s ] 



( 8 ) 

( 9 ) 



The initial states X(0) and f(0) are Gaussian random 
variables with 



E {X(0)} = X(0), E {f(0)} = f(0), 



E { (X(0) - X(0)) (X(0) - X(0)) T } = P x (0) 




34 




Automatic Control and System Engineering Journal, ISSN: 1687-4811, Volume 7, Issue 1, ICGST, Delaware, USA, May 2007 



E {(f(0) - f(0)) (f(0) - f(0)) T } = P f (0) > 0 
The specific values of T f and T s in the augmented state 
space model for each type of fault under consideration 
are as follows: 

(i) .For Sensor bias: 

r f = 0 & T s = I and 

(ii) .For Actuator bias: 

r f =r u e ui &r s = o 

2.1 Augmented State Kalman Filter 

The maximum likelihood estimates of the augmented 
states are generated using Augmented State Kalman 
Filter. 

One step ahead prediction of state estimates and fault 
parameter estimation X a (k + 1/k) is given by 

X fl (k + l/k) =cp a X a (k/k) + r„ a U(k) (10) 



The estimate of state Kalman gain K x (k+1) is given by 



K x (k+1) = P x (k+1) C T [C P x (k+1) C t +R] -1 (19) 

The update of a posteriori state covariance matrix 
T x (k+1) is given by 

T x (k+1) = [ I- K x (k+l)C] P x (k+1) (20) 

The estimate of residual r(k+l) is given by 

r(k+l) = Y(k+1) - Y (k + 1/k) (21) 

Compute the bias Free State estimate X 1 (k+1 /k+1) 

X 1 (k + 1/k + 1) = X (k + 1/k) + K x (k + l)r(k + 1) (22) 

Bias estimator 

Bias transformation matrix U x (k+1) is calculated as 
U x (k+1) = O V(k) + T f (23) 



One step ahead measurement prediction Y(k + l/k) is 
given by 

Y(k + 1/k) = C a X a (k + 1/k) (1 1) 



One step ahead prediction of error covariance P a (k+l/k) 
is given by 



P x 

P f 



— P a (k+l/k)— 0 a P a (k/k) o a T + r wa Q a r wa T 



( 12 ) 



The Kalman gain K a (k+1) is given by 
K a (k+l)=<f> a P a (k + 1/k) C a T [C a P a (k+l/k)C a T +R]-' (13) 

The updated state estimates and parameter estimator 
X a (k + 1/k + 1) are given by 

i^(k+l/k+l)=^(k+l/k)+K a (k+l)[Y(k+l)-Y(k+l/l^](14) 



The sensor bias transformation matrix S(k+1) is 
calculated as 

S(k+l) = CU x (k+l) + r s (24) 

Compute V(k+1) matrix from the relation 

V(k+1) = U x (k+1) - K x (k+1) S(k+1) (25) 

The bias covariance M(k+2) is calculated as 
M(k+2) = M (k+1)- M(k+1) S T (k+1) [C P x (k+l)C T + 
R+S(k+ 1 )M(k+l )S T (k+ 1 )]-' S(k+1 )M(k+ 1 ) (26) 

The Kalman gain for bias K f (k+1) 

K f (k+1) = M(k+2) [ V T (k+l) C T + T s t ] R 1 (27) 

The estimate of Bias parameter F(k + 1/k + 1) is given 
by 

F(k+l/k+l)=[I-K f (k+1 )S(k+l )]F(k/k)-K l (k+l)r(k+l) (28) 
Estimate of Bias correction factor 5(k+l) is given by 
5(k+l) = V(k+1) F(k + 1) (29) 



Error covariance update P a (k+1 /k+1) is given by 
P a (k+l/k+l) = [I- K a (k+1) C a ] P a (k+l/k) (15) 



The Estimate of State is X (k + 1/k + 1) is given by 

X(k + l/k + l) = X 1 (k + l/k + l)+ 5(k + l) (30) 

The initial parameters of the filter are given by 



Where P a (0/0) = Q a = 



P x (0) 

0 



0 

P f (0) 



2.2 Two Stage Kalman Filter 

The algorithm for estimating the state X in the presence 
of bias f is explained as follows: 

State Estimator 

One step ahead bias free state estimate X (k + 1/k) is 
given by 

X (k + l/k) = O X 1 (k/k) + T„ U(k) (16) 

One step ahead measurement Y (k + 1/k) is given by 
Y (k + l/k) = C X (k + l/k) (17) 



P(0)=M(0) = Q U x (0/0) = 0 

3.1 Description of Three-tank benchmark 
system 

The mathematical model of a three-tank benchmark 
problem is considered for simulation studies for 
validating the performance of TSKF and ASKF. The 
three-tank system shown in figure. 1 composed of three 
identical tanks with identical area of cross section. The 
tanks are coupled by two inter connecting pipes; the 
normal outflow is located at tank 3. The measured 
variables are levels of first tank (hi), second tank (h2) 
and third tank (h3) respectively. Inflow of first tank 
(finl) and third tank (fm3) are chosen as known inputs. 
The material balance for the three tank system yields the 
following equations. 



Estimate of a priori state covariance P x (k+1) is given by 



P x (k+1) = O T x (k) 0 T + T w Q r* 



(18) 



dhl finl ClSp- v /2g(hl-h2) 
dt A t A t 



(31) 
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dh2 _ ClS PA /2g(hl-h2) C2Sp V2g(h2 - h3) 
dt ' A x ’ A t ^ 

dh3_ fin3 | C2SpV2g(h2-h3) CSSpV^hS 
dt A j A j A j 

where C 1 C2 C3 — » constant flow coefficient 

Sp — » cross section of the connecting pipe 
g — » acceleration due to gravity (9.81 m/sec 2 ) 
A1=A2=A3=A T —> Area of the tank 




Figurela. Schematic of Three -Tank Bench Mark System 




Figure lb. Three -Tank Bench Mark System 



Table 1. Steady State Operating Data of the 
Three-Tank System 



hl,h2, h3 (m) 


0.5, 0.45, 0.4 


fml and fm3 (ml/sec) 


50 


Area of the tank A T (Al, A2, 
A3) (m 2 ) 


0.0154 


Constant Outflow Coefficients 
(Cl, C2 ,C3) 


1.0 ,0.8 ,1.0 


Cross section of connecting 
pipe(Sp) (m 2 ) 


5 x icr 5 



The system matrices corresponding to linear time 
invariant model (equations 1 and 2) are obtained by 
linearizing and discretizing the non linear differential 
equations (31, 32 and 33) around the nominal values 
shown in table 1 with sampling time t s = 15 seconds then 
the system matrices become 



$ = 



0.68245 0.26315 

0.26315 0.51314 

0.051015 0.20226 



0.051015 

0.20226 

0.61293 



"797.11 


19.284" 




"1 


0 


0“ 


156.74 


122.16 


C = 


0 


1 


0 


19.284 


762.11 




0 


0 


1 



3.2 Validation of FDD scheme on the 
three-tank system 

The ASKF and TSKF based FDD schemes have been 
validated on the model of a three-tank benchmark system 
with identical noise covariance, initial state parameters 
for the following cases. 



Q 



(0.25e- 6) 2 

0 

0 



0 

0 

0 



0 

0 

(0.25e- 6) 2 



R= 



(8.36e- 4) 2 0 

0 (7.08e- 4) 2 

0 0 



0 

0 

(5.09e- 4) 2 



X ( 0 ) = 



P(0) = Q 



P a (0/0) = Q a = 



Q 

o 



0 

0 



x a (0/0) = 



0 

0 

0 

0 



T = V = Zeros (3, 3) and M = Q 

The measurement noise (la) is selected as 0.25% of 
normal height of the tanks. Process noise (la) is selected 
as 0.75% of nominal inflow to tanks 1 and 3 respectively. 



3.3 Simulation Procedure 

Simulation runs are performed using ASKF and TSKF 
algorithms for state and fault parameter estimation on the 
model of three-tank system linearized about the operating 
point 0.5m, 0.45m, 0.4m for tankl, tank2 and tank3 
respectively. The performance of ASKF and TSKF are 
analyzed after deliberately introducing the fault for the 
following situations. 

Case 1 : The slowly varying actuator fault is applied as a 
ramp having zero initial value up to 500 sampling 
instants. The maximum of 0.75e-6 ml/sec (5a) is reached 
at 1000 th sampling instant after which it remains constant 
upto 5000 th sampling instant. 

Case 2: Multiple abrupt simultaneous sensor faults are 
step like faults having zero initial value up to 500 
sampling instants and rise to a magnitude of 2.5e-2m 
(5 a) and 1.5e-2m (5 a) in sensor 1 and sensor3 
respectively. They remain constant up to 5000 th sampling 
instant. 
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Case 3: Multiple abrupt sequential sensor faults are also 
step like faults having zero initial value and rise to a 
magnitude of 2.5e-2m(5a) and 1.5e-2m(5a) at 500 th and 
1000 th sampling instants in sensor 1 and sensor3 
respectively. They remain constant up to 5000 th sampling 
instant. 




Figure 2a. Evolution of true and estimated levels in the 
presence of slowly varying actuator fault - 
ASKF. 




Figure 2b. Evolution of true and estimated slowly 
varying actuator fault (bias) - ASKF. 

Figure 2a shows the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2 , h 3 ) heights of the tanks 1, 2 and 3 in 
the presence of slowly varying actuator bias. From the 
plots it is evident that the estimated states are reasonably 
accurate and they are unbiased. Figure 2b shows the 
evolution of true and estimated slowly varying fault in 
actuator3. From the Figure it is evident that the actuator 
bias estimate is reasonably accurate. 




Figure 3 a. Evolution of true and estimated levels for 
slowly varying actuator fault - TSKF. 




Figure 3b. Evolution of true and estimated slowly 
varying actuator fault (bias) - TSKF. 

Figure 3a shows the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2j h 3 ) heights of the tanks 1, 2 and 3 in 
the presence of slowly varying actuator bias, and the 
estimated states are reasonably accurate and they are 
unbiased. Figure 3b shows the evolution of true and 
estimated slowly varying fault in actuator3. The actuator 
fault is not properly estimated by the TSKF algorithm. 
Even up to 5000 sampling instants the true and estimated 
values are not converging and the estimate is biased. 
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Figure 4a. Evolution of true and estimated levels in the 
presence of abrupt simultaneous sensor fault 
- ASKF. 




Figure 4b. Evolution of true and estimated abrupt 
Simultaneous sensor faults (bias) - ASKF. 

Figure 4a presents the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2 , h 3) heights of the tanks 1, 2 and 3 in 
the presence of simultaneous abrupt faults in sensors 1 
and 3. From the Figure it is to be observed that the 
estimated states are reasonably accurate and they are 
unbiased. The evolution of true and estimated 
simultaneous abrupt faults in sensors 1 and 3 indicated in 
Figure 4b. The figure depicts that the sensor biases are 
estimated accurately by the algorithm within 1500 
sampling instances. 




Figure 5 a. Evolution of true and estimated levels in the 
presence of abrupt simultaneous sensor fault - 
TSKF. 




Figure 5b- Evolution of true and estimated abrupt 
Simultaneous sensor faults (bias) - TSKF. 



Figure 5a provides the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2? h 3 ) heights of the tanks 1, 2 and 3 in 
the presence of simultaneous abrupt faults in sensors 1 
and 3. The estimated states are reasonably accurate and 
they are unbiased. The evolution of true and estimated 
simultaneous abrupt faults in sensors 1 and 3 are shown 
in Figure 5b and the TSKF algorithm cannot estimate the 
fault magnitudes accurately. They are biased with offsets 
0.2436e" 2 and 0.1528e- 2 even at 5000 th sampling instant. 
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Figure 6 a. Evolution of true and estimated levels in the 
presence of abrupt sequential sensor faults - 
ASKF. 




Figure 6 b. Evolution of true and estimated abrupt 
Sequential sensor faults (bias) - ASKF. 



Figure 6 a shows the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2 , ^ 3 ) heights of the tanks 1, 2 and 3 in 
the presence of multiple abrupt sequential fault in sensors 
1 and 3. The estimated states are reasonably accurate and 
they are unbiased. Figure 6 b presents the evolution of 
true and estimated multiple abrupt faults in sensors 1 and 
3 and the sensor biases are estimated accurately within 
1500 sampling instances. 




Sampling Instants 

Figure 7a. Evolution of true and estimated levels in the 
presence of abrupt sequential sensor fault - 
TSKF. 




Figure 7b- Evolution of true and estimated abrupt 
Sequential sensor faults (bias) - TSKF. 



Figure 7a presents the evolution of true (hi, h 2 , h 3 ) and 

estimated (hi, h 2j h 3 ) heights of the tanks 1, 2 and 3 in 
the presence of multiple abrupt sequential faults in 
sensors 1 and 3. The estimated states are reasonably 
accurate and they are unbiased. Figure 7b shows the 
evolution of true and estimated multiple abrupt faults in 
sensors 1 and 3 and the algorithm cannot estimate the 
fault magnitudes accurately and they are biased with 
offsets 0.2536e" 2 and 0.1528e" 2 respectively even at 
5000 th sampling instant. 
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3.4 Monte-Carlo simulation studies for 
performance Evaluation 

The term Monte-Carlo simulation (MCS) means any 
simulation which utilizes random numbers in the 
simulation algorithm. Monte-Carlo simulation is also 
called as stochastic simulations. MCS is based on the use 
of random numbers and probability statistics to obtain an 
answer to scientific problems. Estimation does not 
provide a measure of uncertainty. Where as MCS allows 
to quantify the uncertainty in the response of several 
variable [14]. MCS is the key technology to quantify 
uncertainty and consequences of making a mistake for 
optimal decision making. 

Since the process simulations are carried out in the 
presence of process and measurement noises. The 
performance of the observer cannot be accessed based on 
single simulation trail because in real time the noises are 
random which may vary from time to time. In order to 
assure the accuracy of estimate ten different sets of 
random noise sequences using random numbers with 
different seed values are generated and all the simulation 
runs are conducted in the presence of ten different 
random noise sequences, for all above observer, for all 
type of faults namely slowly varying actuator fault, 
multiple abrupt simultaneous faults and multiple abrupt 
sequential faults. Considering the noise magnitude as la 
the fault magnitudes are varied as la, 3a and 5a for the 

state estimates. The mean E[ b ] and variance a[ b ] of the 
fault magnitude estimates are computed for the last 100 
sampling instants. The averaged values of mean and 
variance estimates of all trials in a run are presented in 
Tables 2, 3 and 4. 



Table2. Mean and Variance of fault magnitude 
estimate (Single actuator fault) 



Fault 

magnitude 

introduced 


ASKF 


TSKF 


Actuator 1 


Actuator 1 
E[b],(<r[b]) 


Actuator 1 
E[b],(cr[b]) 


la = 0.15e-6 


1.6907e-7 
( 6.9753e-24) 


1.2933e-7 

(3.01523e-15) 


3a = 0.45e-6 


4.6907e-7 

(6.9753e-24) 


3.8403e-7 

(2.1599e-14) 


5a = 0.75e-6 


7.6907e-7 

(6.9753e-24) 


6.3873e-7 

(3.9821e-14) 



Table3. Mean and Variance of fault magnitude 



estimate (Simultaneous and Sequential sensor 
faults) 



Fault magnitude 
introduced 


ASKF 


Sensorl 


Sensor3 


Sensorl 

E[b],(atb]) 


Sensor3 
E[b], (cr[b]) 


la=5e-3 


la=3e-3 


5.0658e-3 

(7.6778e-18) 


3.0577e-3 

(1.1974e-17) 


3a=1.5e-2 


3a=9e-3 


1.5065e-2 

(7.2599e-18) 


9.0576e-3 
(1.1 183e-17) 


5a=2.5e-2 


5a=1.5e-2 


2.5065e-2 

(7.6456e-18) 


1.5057e-2 

(1.0964e-17) 



Table4. Mean and Variance of fault magnitude 

estimate (Simultaneous and Sequential sensor 
faults) 



Fault magnitude 
introduced 


TSKF 


Sensorl 


Sensor3 


Sensorl 

E[b],(a[b]) 


Sensor3 

E[b],(<x[b]) 


la=5e-3 


la=3e-3 


4.4956e-3 

(3.2187e-8) 


2.61925e-3 

(1.9354e-8) 


3a=1.5e-2 


3a=9e-3 


1.3480e-2 

(1.0095e-7) 


8.0819e-3 

(5.9301e-8) 


5a=2.5e-2 


5a=1.5e-2 


2.2464e-2 

(1.6860e-7) 


1.3472e-2 

(9.9134e-8) 



4. Conclusion 

The performance of the FDD scheme based on 
simultaneous state and fault parameter estimation is 
validated on a three-tank system for an abrupt as well as 
slowly varying fault. From the simulation studies on 
three-tank system, it is concluded that the performance of 
ASKF is better than TSKF for single, multiple 
simultaneous and sequential faults as it generates smooth 
estimates. The processing time is fixed for TSKF for any 
number of faults whereas it will vary for ASKF when the 
numbers of faults vary. It is observed that probability of 
occurrence of false and missed alarms are very low in 
ASKF, as compared to TSKF. The proposed ASKF based 
robust FDD scheme can very well be integrated with any 
conventional control scheme to develop a fault tolerant 
control scheme. 
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Abstract 

Senseless induction motor drives are widely used in 
industry for their reliability and flexibility, particularly in 
hostile environment. However, the performance of many 
of previously developed observer based speed sensors in 
very low speeds of IM drives was not satisfactory. In this 
paper we present two types of MRAS based speed 
estimators, one based on the rotor flux and the other 
based on the back EMF. The estimated speed is used as 
feedback in a vector control system. The MRAS 
approach has the immediate advantage in that the model 
is simple, presents the theory, modelling and this method 
because eliminates the produced error in the speed 
adaptation, is more stable and robust. Simulation results of 
the proposed MRAS speed observer based sensorless 
field-oriented induction motor drives. The performances 
of both techniques are evaluated in indirect vector control 
system and the results are presented. 

Keywords: Sensorless induction motor, model reference 
adaptive system (MRAS), speed estimator. 

1. Introduction 

Induction motors have been widely used in high- 
performance ac drives, requiring . information. 
Introducing a shaft speed sensor decreases system 
reliability, and different solutions for sensorless ac drives 
have been proposed. The MRAS speed estimators are the 
most attractive approaches [1], due to their design 
simplicity. 

The MRAS is based on principle, in which the outputs of 
two models -one independent of the rotor speed 
(reference model) and the other dependent (adjustable 
model)- are used to form an error vector[l]-[7]. The error 
vector is driven to zero by an adaptation mechanism 
which yields the estimated rotor speed. Depending on the 
choice of output quantities that form the error vector, 
several MRAS structures are possible. The most common 
MRAS structure is that based on the rotor flux error 
vector [2] which provides the advantage of producing 
rotor flux angle estimate for the field-orientation scheme. 
Other MRAS structures have also been proposed recently 
that use the back EMF and the reactive power as the error 



vectors estimators. It is the intention of this paper, 
therefore, to present a direct comparison between two 
different MRAS approaches: the rotor flux based and the 
back EMF based MRAS [9] [10]. The rotor flux based 
MRAS approach studied in this paper basically follows 
that of, while the back EMF based approach is the 
modified form of the one developed in. To allow for a 
fair comparison, no on-line parameter methods will be 
incorporated and same current controllers and a PWM 
generation technique will be used in both approaches. In 
order to compare the performances of the two estimators. 
Several performance measures are evaluated in computer 
simulations. The studies include the level of difficulties 
in tuning the adaptive gain constants and the tracking 
performances of both speed estimators. To obtain 
accurate estimation of the speed, a simple on-line 
identification approach has been incorporated. Based on 
the theory of MRAS, simultaneous estimation of rotor speed 
has been described in this paper. Comparing to other 
adaptation techniques, this method is simple and needs a 
low computation power and has a high speed adaptation 
even at zero speeds. This method because eliminates the 
produced error in the speed adaptation, is more stable and 
robust. Computer simulations results are presented to 
show its effectiveness. 

2. Field Oriented control theory 

One particular approach for the control of induction 
motors is the Field Oriented Control (FOC) introduced by 
Balaschke in [5] [8]. The machine equations in the stator 
reference frame, written in terms of space vectors, are 



Vs =R s Is+^- 

dt 


( 1 ) 


0 = R l r + Etta jcotncp 
dt 


( 2 ) 


Q s =LIs+Atlr 


( 3 ) 


(p r = L r Ir +MI, ( 1 ) 


( 4 ) 
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d£l _ T - T l 



dt J 

T M , • 

T = p ir <Pn,tsq 



-Prchd) 



( 5 ) 

( 6 ) 



This control strategy is based on the orientation of the 
flux vector along the d axis [4], [6] which can he 
expressed by considering: 

<P d r’ q ={<P 1 rd fiY ( 7 ) 




Assuming a rotor flux reference frame, and developing 
the previous equations with respect to the axis and axis 



components, leads to. 




^3 

II 

15 

1 ^ 
+ 

^3 


(8) 


ii 


( 9 ) 



These equations represent the basic principle of the FOC: 
in the rotor flux reference frame, a decoupled control of 
torque and rotor flux magnitude can be achieved acting 
on the d and q axis stator current components, 
respectively. A block diagram of a basic DFOC scheme 
is presented in Figure 1. The rotor flux estimation is 
carried out by. 

^-=v,-R,i, (10) 

dt 

(Pr = ~ aL si') ( U ) 



Figure 1. Block diagram of the proposed MRAS 




3.1. MRAS based on rotor flux-linkage estimation 
The proposed MRAS is using state observer model with 
current error feedback and rotor current model as two 
models for flux estimation. Figure 3 shows the block 
diagram of the proposed MRAS [4]. 



The flux estimator has been considered to be ideal, being 
the effects due to parameter variations at low speed out of 
the major aim of this paper. The current controller has 
been implemented in the rotor flux reference frame using 
PI regulators with back emf compensation. 

3. Model Reference Adaptive System 

The Model Reference Adaptive Systems (MRAS) 
approach uses two models. The model that does not 
involve the quantity to be estimated (the rotor speed re in 
our case) is considered as the reference model. The 
model that has the quantity to be estimated involved is 
considered as the adaptive model (or adjustable model). 
The output of the adaptive model is compared with that 
of the reference model, and the difference is used to drive 
a suitable adaptive mechanism whose output is the 
quantity to be estimated (rotor speed in our case). The 
adaptive mechanism should be designed to assure the 
stability of the control system. Figure 1 illustrates the 
basic structure of MRAS [l]-[7],[9]. Different 
approaches have been developed using MRAS, such as 
rotor- flux-linkage estimation-based MRAS, back-EMF- 
based MRAS (reactive-power-based MRAS) [9]. 

The Overall system of the proposed sensorless control 
algorithm is shown in Figure 2. 



The reference model is given by: 



V rd = -p-(f (psd ~ RsL )* - ° L sKd ) 

m 

w — — — {[ (u — R i \it — cj L i 1 

r rq ^ VJ V sq s * sq /** s sq J 



( 12 ) 



The adjustable model is given by: 

Vrd = ~^( L J S d -Vrd 

1 r 

{// — -^—{l i — w — co T u? . ) 

t rq rj-t \ fit sq t rq r rr rd / 



(13) 



Where vj/^,\j/ r<? : estimated values of rotor fluxes in state 
observer model 

ur . , vEr : estimated values of rotor fluxes in rotor current 

T rd y T rq 



model. Rotor speed is obtained from the adaptation 
mechanism as follows [4] [9] : 



03. = 



p j 



(v 






(14) 
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The presence of the pure integrators brings the problems 
of initial conditions and drift. In [4], To reduce the 
effect of the derivative terms, a similar approach as 
that used to eliminate the pure integration problem a 
low pass filter was used to replace the pure integrator, but 
the performance in the low speed range is not satisfying, 
for reasons which will be explained later. 




Figure 3. MRAS based on rotor Flux-linkage estimation 



3.2. MRAS based on back-EMF estimation 
This paper proposes a novel sensorless control algorithm 
based on the MRAS for the speed sensorless control of a 
induction motor. The proposed MRAS is using the state 
observer model of (15) and (16) and the magnet flux 
model of and as two models for the back-EMF 
estimation. The rotor speed is generated from the 
adaptation mechanism using the error between the 
estimated quantities obtained by the two models as 
follows in Figure.4, [8], [9]. 

The reference model is given by: 
e — u , — R i , — L f i > 

d sd s sd s sd /i 




Figure 4. The MRAS speed observer; 



This scheme does not have pure integrators in the 
reference model. 




4. Interpretation results 

To validate the performances of the proposed controller, 
we provide a series of simulations and a comparative 
study between the performances of the proposed control 
strategy. A 1.5kW induction motor with controller is 
simulated using the nonlinear controller and the 
following motor parameters: Pn=1.5kW, Un = 230V, 
Rs = 2.89Q, Rr = 2.39Q, Fs = 0.225H Fr = 0.225H, 
Fm=0.214H, 



The adjustable model is given by: 

. = L m L m i sd - y/ rd - o) r T r y? rq 

6,1 L r T r (16) 

, L m L _J I1 

Bq L T 

r r 

The adaptive mechanism is given by [3, 9]: 
oj — K \e n e — e e n )+ K \ (in e — i e n ]dt ( 12 ) 

re p V fis as as ps / / J \ ps as as Ps 

Where K h and K py are the gain constants, i, and p are the 
estimated values of back-EMF in the state observer 
model, [4]. Are the estimated values of back- EMF in the 
magnet flux model. 

Figure 4 shows the block diagram of the proposed MRAS 
algorithm has a robust performance through combining 
the state observer model and the magnet flux model [4]. 



4.1. Tuning the adaptive gain constants 
Simulation studies have been performed to compare the 
level of difficulty in tuning the adaptive gain constants 
for the two speed estimators. Figure. 6 shows the 
simulation results of the speed sensorless vector control 
using the rotor flux based MRAS speed estimator for 
different adaptation gain constants. It can be seen that 
low values of adaptation gains do not yield in 
convergence of the speed or the fluxes see Figure 6. a 
increasing the gains yield in better convergence of the 
estimations as shown in Figure 6.b and 6.c. 

Figure. 7 shows simulation results of the back EMF based 
MRAS for different adaptation gain constants. It was 
found that the relationship between the adaptation gain 
constants and the tracking performance is not as simple 
as in the case of the rotor flux based MRAS. Increasing 
the gain constants in the rotor flux based MRAS in 
general results in a better tracking performance. In the 
back-EMS based MRAS, this has not always been the 
case. From Figure 7(a ,b) , it can be seen that increasing 
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AT/ from 0.04 to 25 while keeping K P at 0.001 helps to 
improve the tracking performance. However, when K P is 
increased to 0.01 while Kj is kept at 25, the steady state 
error of the estimation increases as can be seen in 
Figure. 7c. More surprising results were obtained when 
K P is further increased to values greater than 
approximately 0.01, since the results then became 
unstable. The fact that the results went unstable for 
certain values of the adaptation gain constants had made 
the process of tuning them a difficult exercise [9]. 

4.2. Speed Estimators Tracking Performances 
Simulation studies have been performed to compare the 
tracking performances of the two speed estimators. In 
these studies, the machine was operated in the indirect 
vector control operation using the speed sensor signal, 
while at the same time estimation of the speed using each 
of the MRAS speed estimators was performed. 

Figure 8 shows the simulation results of the rotor flux 
base MRAS speed estimator when the machine is 
operated at different speed. It can be seen that at 
relatively high speed Figure 8a, the estimated speed 
tracks the actual speed reasonably well. As the speed is 
decreased, however, the steady state values of the 
estimated speed tend to deviate from those of the actual 
speed [9]. These deviations were most likely caused by 
the error in the stator resistance Rs. At lower speed, the 
stator voltages and currents vary at lower frequency. As 
the frequency decreases, the term R.i/p becomes 
relatively larger. Therefore, an error in the value of Rs, 
will seriously effect the estimated speed as the frequency 
approaches zero. 

This error, however, is usually quite negligible at high 
excitation frequency [9]. 

Figure 9 shows the simulation results of the modified 
back-EMF speed estimator. From these results it can be 
seen that good tracking performances can still be 
achieved even at the speed of 85 rpm. 

Unlike the rotor- flux based MRAS, here the error in the 
value of Rs, does not seriously effect the estimation at 
low speed 

4.2. Influence of variation of both rotor resistance and 
load torque 

Show the speed responses in case of considering the 
parameter variations where the rotor resistance is 
increased by 100% and torque load by 50% of the 
nominal value. The parameter variations are applied in 
the middle of the operation of [60 and -60] rad/sec. 

The simulation results show that the two proposed 
methods sensorless control algorithm has good speed 
responses, for two proposed methods shown Figure 
(10a, 10b), but the rotor flux for rotor flux based MRAS 
presented of the ripple in steady state compared whit 
rotor- flux based MRAS method as it is to show on Figure 
(11a, llb);it could be expected that the stator current in 
rotor flux based MRAS has more harmonic distortion 
because the effects caused by flux drooping is more 
evident as show in Figure (12a, 12b). 

5. Conclusion 

This paper proposed a novel speed sensorless control 
algorithm of induction motor. The proposed control 




algorithm is based on MRAS using state observer model 
with the rotor flux based MRAS technique and the back 
EMF based MRAS technique, comparing to other 
adaptation techniques, this method is simple and needs a 
low computation power and has a high speed adaptation 
even at zero speeds. These important features are very well 
shown in the obtained results who indicate that the 
proposed algorithm shows good speed responses in the 
low and high speeds in the rotor flux based MRAS and 
the back EMF based MRAS speed estimators. It was 
shown that although the low speed performance of the 
back EMF MRAS speed estimator is better than the rotor 
flux based MRAS, the back EMF MRAS estimator is 
more difficult to design due to the non-linear effect of the 
adaptation gain constants. 
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8. Simulation results 



FREQUENCE DE ROTATION actual and Estimated s P eed 





Temps[s] Temps[s] 



(a) K p =0.004 Ki=0.008 (a)K p =0.001 K^O.04 





(b) K p =0.4 K;=4 



(b) K p =0.001 Ki=25 





(c) K p =0.01 Ki=20 (c) K p =0.01 fQ=25 



Fig. 6. Simulation results Actual and Estimated speed : effect of 
different adaptation gains in the rotor flux based MRAS 



Fig. 7. Simulation results Actual and Estimated speed: effect of 
different adaptation gains in the back EMF based MRAS 
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Fig. 8. Simulation results: modified rotor flux MRAS estimator for speed references at (a) 380rpm (b) 275 rpm (c) 190 rpm (d) 85 rpm 
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Fig. 9. Simulation results: back-emf based MRAS speed 
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Fig. 10. a: Rotor speed 




Fig. lO.b: Rotor speed 




Fig. 11. a: Rotor flux 



Fig . 1 1 .b : Rotor flux 
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MRAS based on rotor flux-linkage estimation with variation 
of rotor resistance and load torque 



MRAS based on back -EMF with variation 
resistance and load torque 
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Abstract 

This paper presents the design of course-following 
controller for an autonomous boat with low-cost sensors 
by applying H 2 /Hoo robust control approach. At first a 
mathematical model for the under actuated boat is 
derived which captures the dynamics between rudder 
deflection and the boat’s horizontal motion. The resulted 
model could be seen as an extension to the Nomoto’s 
model. Despite of its simplicity, the model offers the 
advantage that no compass is required for control, which 
promotes integrated steering and guidance at low cost. 
Based on the model, mixed H 2 /Hoo control approach is 
applied to provide robust stability in the presence of 
model uncertainty and environmental disturbance while 
maximizing the performance in the sense of H 2 norm. 
The proposed modeling and control strategies are tested 
on a small autonomous boat whose length is about 1 
meter. A low-cost GPS receiver and a gyroscope are used 
for navigation and control. The course-following 
performance has been demonstrated at sea trials. The 
standard deviation of the cross track error is 2.3 m which 
is a good result for the small boat with such low cost 
sensors. 

Keywords: Autonomous boat, Course-following control, 
Mixed H 2 /Hoo, Modeling, Low cost. 

1. Introduction 

Autonomous vehicles have been of great research interest 
in recent years as they are promising means to remove or 
reduce human labors’ workload. Different kinds of 
autonomous vehicles are developed or under 
development. A broad classification would include UAV 
(Unmanned Aerial Vehicle), UGV (Unmanned Ground 
Vehicle), AUV (Autonomous Underwater Vehicle) and 
ASC (Autonomous Surface Craft). While state-of-the-art 
technologies are applied to pursue good performance, the 
cost-effectiveness has been becoming another focus for 
practical applications. High cost will inevitably hinder 
the application. “Low cost” has turned to be one key 
word in recent studies [1-4]. In this paper, we study the 



design of course-following control for a small low-cost 
boat by using mixed H 2 /Hoo approach. The autonomous 
boat is expected to be applied for seabed survey, mapping 
and aquatic environment monitoring. The performance 
and cost issue should be considered and balanced. 

The vehicle under study is a small boat which is 1060 
mm long with a mass of 12 kg. To our knowledge, it is 
the smallest one among those reported in the literature. 
The small dimension and low weight cause it be easily 
affected by environmental disturbances such as wind, and 
waves, which is one challenge for the control. The fact 
that the boat is driven by DC motors poses another 
challenging problem in installing a low cost magnetic 
compass to measure the yaw angle which is normally 
required by many existing control strategies. [5,6,7] The 
compact space makes it hard to compensate or isolate the 
magnetic disturbance from DC motors. Although 
gyrocompass could be used, the additional cost is not 
preferred. This motivates our study on control and 
navigation of an autonomous boat without using a 
compass. Instead we use GPS for its near global coverage 
and ease of use for positioning. 

Although the marine vehicle control problem has been 
widely studied since the first automatic ship steering 
mechanism was constructed by Elmer Sperry in 1911 [8]. 
To control a boat without using a compass is less 
addressed. Some recently reported autonomous surface 
vehicles include a wind-propelled marine vehicle from 
Stanford University [9], an autonomous surface platform 
for research in cooperative autonomy by MIT[10], a 
robotic boat for microbial observation by University of 
Southern California[l 1], and the DELFIM autonomous 
surface craft developed at Institute for systems and 
robotics, Portugal for data acquisition and 
communication relay [12]. These autonomous systems all 
utilize compass for yaw angle measurement. 

To realize the control strategy with a GPS, the dynamic 
relationship should be investigated. We have developed a 
simple dynamic model describing the boat’s maneuver 
with measurement from GPS. It could be seen as an 
extension to the Nomoto’s first order model by 
introducing the relationship between the boat’s heading 
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and its moving direction. This model keeps the simplicity 
of Nomoto’s model. In addition, it enables the course- 
following control of a boat in the absence of a compass. 
We have designed and implemented a course-following 
controller using H 2 /Hoo robust control technique based on 
the developed model. The control approach is applied to 
optimize the performance in the sense of H 2 norm while 
maintaining robust stability in the presence of ignored 
dynamics and environmental disturbances. 

The choice of H 2 /Hoo control method is because that the 
method offers a systematic way in designing linear 
controller, unlike other control schemes such as adaptive 
control, fuzzy control, or neural networks which actually 
synthesize nonlinear controller even if the plant is linear. 
In implementation, linear controllers are usually less 
complicated than nonlinear controllers. What’s more, 
these control methods lacks such systematic way as 
H 2 /Hoo. In H 2 /Hqo controller design the stability and 
performance requirements can be enforced by choosing 
frequency dependent weighting functions properly. 

The performance of the controller has been verified 
through sea tests. The standard deviation of cross track 
error is 2.3m. This performance is achieved by using low 
cost sensors: a GPS receiver and a gyroscope. The total 
costs are below $100. 

In the following text, we will describe the mathematical 
model in Section (2) and discuss the controller design in 
Section (3). We will give a brief introduction of the boat 
platform in Section (4). In section (5), we will present the 
experimental results. And finally, in section (6), we will 
give concluding remarks and summarize this study. 

2. Mathematical model 

The mathematical model of a boat can be obtained by 
applying Newtonian or Lagranigian theory. With this 
approach, the force and torque must be modeled 
explicitly. It involves modeling the complicated 
hydrodynamic effects through wave-hull interaction. This 
is usually done by approximating the effect with 
hydrodynamic derivatives. However, these parameters 
rely mostly on experiments such as tests by tow tank, by 
rotating arm device, and by planar motion mechanism for 
identification, which suggests a costly and maybe time- 
consuming process before a meaningful model can be 
obtained. Some simplified models, on the other hand, do 
not require such detailed modeling which catches the 
dominant dynamics only. Nomoto’s model [13] is one of 
the simplified models. It describes the yaw motion of a 
boat. The simplicity of Nomoto’s model is attractive for 
control law design. In literature, many ship autopilots are 
based on this model such as [6,23,24]. With the desire to 
get a simple model, we start with the Nomoto’s model 
and extend it to include the motion in horizontal plane. In 
this section, we will first review the Nomoto’s model and 
then develop the extension for modeling the horizontal 
motion. 



r(s) = ftoPr 3 + l) 

S(s) (st x + 1)(ST 2 +1) 



This model shows the dynamic effect of rudder deflection 
angle S on yaw rate r . It is noticed that one of the poles 
in Equation (1) is nearly cancelled by its zero [14]. With 
this fact, Equation (1) is further simplified into Equation 
(2). It is called the first order Nomoto model. 



Kf) _ K 

£(s) (ST + 1) 



( 2 ) 



where T — T x +T 2 —Z 3 . 

The Nomoto’s model is valid on the assumption that the 
boat moves at constant forward velocity, the propelling 
thrust is constant and the rudder angle is small. Given 
that the conditions are satisfied, the Nomoto model gives 
a reasonably accurate description of the course-keeping 
behavior [14]. 

In Equation (2) the rudder actuator model is absent; we 
need model steering machine which actuates the rudder 

to get the model from steering machine command 5 m 



to the yaw rate. Suppose the steering machine can be 
modeled linearly as Equation (3), 






= G(s) 



(3) 



we obtain the yaw model with actuator considered by 
substituting Equation (3) into Equation (2). 



r(s) _ K 

S m {s) («■ + !) 



G(s) 



(4) 



In this study, the rudder actuator of the boat under 
investigation is a DC servo motor. The response of the 
servo motor is much faster than yaw response of the boat. 
By time scale separation principle, the actuator can be 

modeled as a constant gain k x . Then we get the model 



from servo motor command to the yaw rate as shown in 
Equation (5). 

rfs) k 

— — = (5) 

< 5 » («■ + !) 



where k = k 0 • k x . 

The boat’s yaw motion is modeled in the form of 
Equation (5) with the two parameters k and x identified 
through experiments. A comparison of the model output 
and the boat’s response is shown in Figure 1. 




2.1. Nomoto’s Model 

In 1957 Nomoto proposed two transfer functions based 
models for steering simulation and control [14], namely 
the second order Nomoto model and the first order 
Nomoto model. The second order Nomoto model is 
shown in Equation (1). 



Figure 1. Validation of yaw model: the blue line shows the 
simulated output from the model; and the green line shows the 
actual output of the boat 




52 




Automatic Control and System Engineering Journal, ISSN: 1687-4811, Volume 7, Issue 1, ICGST, Delaware, USA, May 2007 



2.2. Translational Model 

It is not enough to only maintain the boat’s heading if we 
want it to follow a straight line course especially for the 
small boat. Since its speed is slow and is of low inertia, it 
is easy to be disturbed and deviates from the course faster 
than full scale ship. The translational model under 
discussion is limited to be on the horizontal plane which 
is illustrated in Figure 2. We use symbols shown in Table 
1 to describe the motion of the boat. 




Figure 2. Description of boat’s motion in horizontal plane 



Table 1. Nomenclature 



Symbol 


Definition 


¥ 


Yaw angle (heading angle) 


r 


Yaw rate 


a 


Side slip angle between boat’s 
heading and its moving direction 


p 


The boat’s moving direction 
(velocity angle) 


V 


Velocity vector 


u 


Surge velocity 


V 


Sway velocity 


s 


Rudder deflection angle 



We make similar assumptions as Nomoto model did that 
the boat is driven by constant thrust; the boat runs at 
constant speed; and the boat may experience small yaw 
perturbation. In perturbation free condition, the boat runs 
along straight line at constant speed. The forces acting on 
the boat reach balanced state that the thrust denoted by T 
equals to the total drag denoted by D. Also there is no 
side slip between the boat’s heading and its moving 
direction. The equilibrium state is described by Equation 
( 6 ). 



f T = D 

\a = jB-y/ = 0 



When the boat’s heading undergoes a small perturbation, 
the side slip angle is no longer zero. This results in 
unbalance between the thrust and drag due to the nonzero 
incident angle between the forces’ directions as 
illustrated in Figure 3. The boat will be accelerated till 
another equilibrium state as depicted in Equation (6) is 
reached. We assume the velocity loss in the process is 
negligible. Then the magnitude of velocity can be treated 
as unchanged. This condition is described by Equation 

(7). 



-\V\ = 0 
dV 1 



(7) 




Figure 3. Simplified view of forces acting on the boat under small yaw 
perturbation 



Since the drag is proportional to the square of boat’s 
velocity, it will be constant under the assumption of 
Equation (7). The drag’s direction is opposite to the 
direction of the velocity. The equation of motion of the 
boat under small yaw perturbation can be expressed by 
Equations (8) and (9). 

m(u - y/v) = T - D • cos a (8) 

m{v + y/u) = —D • sin a (9) 

The m terms include the added mass effect. The added 
mass reflects the build-up of kinetic energy of the fluid as 
the hull moves through it which results the boat moves 
with equivalent additional mass in effect [15]. 

With the assumption of Equation (7), we can express the 
boat’s velocity in the body coordinate as: 

[u = iFl-cosa 

• do) 

I v = |K|-sin a 



Substituting Equation (10) into Equation (9), we obtain 
Equation (11). 

D 

a = -—-tan a-y/ (11) 

m\y\ 

When the side slip angle a is small, Equation (11) can be 
linearized as: 



1 

a = — a-y/ 



( 12 ) 



where A = m |F | j D . 

With the definition of side slip angle indicated in 
Equation (6), we obtain Equation (13). 

kfB + fB^y/ (13) 

Take Laplace transform on Equation (13) and combine 
Equation (5); we obtain the transfer function from rudder 
servo command to the boat’s moving direction. 



8 m {s) s(/Ls' + l)(,sr + l) 

This equation expresses the dynamics in the case that 
ideal sensor is available for velocity angle measurement. 
In fact, we use a low cost GPS for this purpose. The 
update rate of the GPS is only 1Hz. Our tests show that 
the measurement delay of the GPS is around 2-3 seconds, 
which can not be ignored. We explicitly model the delay 

T d to obtain the transfer function from servo command 




to the GPS measured velocity angle 



P d - 
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fid( S ). = e -sT d 



(15) 



s (As + l)(sr + 1) 

output and the boat’s actual 



The simulated model 
response are shown in Figure 4, where blue line indicates 
the model output and the green line represents the actual 
velocity angle measured by GPS. 




Figure 4. Validation of the translational model 

2.3. Course-following Model 

In application, a boat usually moves along a straight line 
course in most cases. The boat is considered to be on the 
track if it moves in the direction of the line, and at the 
same time the perpendicular distance to the line is around 
zero. Let us consider the case that the boat is commanded 
to move from starting point A to the goal point B along a 
straight line as illustrated in Figure 5. Without loss of 
generality, we take the starting point A as origin of the 
reference frame. 




The off track d is defined in Equation (16) which shows 
how far the boat deviates from the specified course. 

7 AB x Ao 

d= — = — (16) 

AB 

Let y be the difference between the boat’s moving 
direction and the course direction 6. The unit for angle 
expression is degree. 

Y = P~0 (17) 

Then the off track distance d satisfies Equation (18). 

j = |F|*sin;r (18) 

Under the condition of small variations around the line, 
Equation (18) can be approximated by Equation (19). 

j = |F|-Vl80-7 (19) 

The off course distance is calculated based on the 
position measured by GPS. Due to the delay in GPS 
measurement, the calculated off course distance is a 
delayed version. We use the same symbol to represent the 
measured off course distance as is shown in Figure 6. 




A 



> r 



Figure 6. Block diagram of the plant model 
Since the delay is infinite in dimension, we use its first 
order Pade approximation to get finite order model. 

\-s(T d n) 






( 20 ) 



1+dV 2) 

Its state space representation is described in Equation 

( 21 ). 

fx = Ax + BS m + F0 
[y = Cx 



( 21 ) 




B = [k/r 0 0 0 0] 

'0 0 0 0 1 

C= 0 0 0 1 0 

1 0 0 0 0 

F = [0 0 0 0 -|F|-^/180] r 

The numerical values of the parameters are listed in 
Table 2. 



Parameter 


Value 


k 


2 


T 


0.4 


A 


1.32 


\ v \ 


1.1 




2 



The plant model is unstable since it has two poles at 
origin which can be observed in Figure 6. 

3. Controller Synthesis 

The course following controller is required for the boat to 
be able to follow a spatially specified path which is 
studied as the path following or trajectory following 
problem. In [16], a line of sight guidance control for 
following straight line and circle trajectories is presented. 
More general trajectory following cases are discussed in 
[17,18]. In general, these approaches first parameterize 
the tracking error in a proper way and then construct a 
nonlinear control law to force the tracking error to 
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approach zero asymptotically. Numerical simulation 
results have demonstrated good tracking performance. 
However, it is not clear on the performance in real sea 
condition. 

We design the controller to follow straight line 
segmented course which is specified by waypoints. It is 
believed that this is the most used application mode. The 
controller design will be based on the mathematical 
model developed in last section. The model keeps a 
simple form under the condition of several assumptions. 
However, the discrepancy between the reality and the 
assumptions exists, which is one source causing model 
error. For example, we assume that the boat’s speed does 
not vary in the course of yaw change which in fact does 
decrease. Another source of model error comes from the 
ignored dynamics such as the effect of waves. The model 
error can be mitigated by refinement, i.e. using nonlinear 
model. This option will increase model accuracy, but 
may lead to complexity in controller, which is not 
desirable. Instead of trying to improve the model, we 
apply robust control theory to design controller in the 
presence of model error. 

Hoc optimal control is one popular scheme in robust 
control theory. It is formulated under the small gain 
theorem and can guarantee robust stability with norm- 
bounded model uncertainty [19]. While the small gain 
stability condition can be directly expressed by using Hoo 
norm, yet there are cases where H^ norm can not best 
interpret the performance specifications. Mixed H 2 /Hoo 
approach is one method that addresses the performance 
objectives in both H 2 norm and H^norm [20]. The mixed 
H2/HOO method has been successfully applied in 
applications such as vibration control of flexible 
structures [21], robust fault detection [22] and so on. 




Figure 7. The generalized plant for controller design 
In the course following control, the objective is to keep 
the boat’s moving direction error y and the off track 
distance d both be small. These can be seen as variations 
around the reference course when influenced by random 
disturbances. The variance should be kept to be small in 
order to follow the course. This performance requirement 
is naturally translated into H 2 control problem. The 
ignored disturbance and unmodeled dynamics are treated 
as input multiplicative model uncertainty on the fact that 
both wind and wave disturbance can be regarded as 
external inputs to the boat. In Figure 7 we show the 
generalized plant for controller synthesis. The plant 
model as depicted in Figure 6 has one control input: the 
rudder command and three measured outputs: the off 
track distance, the moving direction and the yaw rate. 
The input 6 is the reference course angle which can not 
be manipulated for control. The controller will 
manipulate the rudder command to achieve course 
following goal. 



The block P in Figure 7 refers to plant model as 
described by Equation (21). 

Let J 2 and be defined as follows: 




( 22 ) 



(23) 

where G and R represent the corresponding closed loop 
transfer functions between the inputs and outputs as 
stated in Equations (22) and (23) respectively, then the 
design objective can be concisely described as: subject to 
the constraint J ^ < 1 , find controller K which minimize 

j 2 . 

The weighting functions W l and W 2 are chosen to 

balance the performance of direction keeping and track 
following. Due to the boat’s nonholonomic motion, 
actions trying to minimize one performance index will 
likely worsen the other. When large emphasis is placed 
on direction keeping, the boat becomes difficult to turn. 
On the other hand, if too much emphasis is placed on the 
off track error, the boat will be too aggressive to return 
back to the course and may oscillate to progress slowly in 
the direction of the reference course. The weighting 
functions used in this design are shown in Figure 8 which 
has been verified in our experimental investigation. 
When the synthesis problem is well formulated, the 
controller can be found by LMI solver efficiently. We use 
the MATLAB toolbox to complete the design. 

The robust stability is verified in evaluating the Hoo norm 
of the system R in Equation (23). We show its singular 
value plot in Figure 9 which show that the robust stability 
condition < 1 is satisfied. 



*/ = 



Rr 




Frequency [rad/s] 



Figure 8. Gain plot of weighting functions 




Figure 9. Singular value plot of system R 
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4. Testbed Description 

The boat under study is a product of Coden company. Its 
picture is shown in Figure 10. The screw is propelled by 
two DC motors and the rudder is actuated by a servo 
motor. The boat is remotely controlled through IEEE 
802.11 wireless LAN. GPS and sonar sensor are standard 
equipment available on the boat. We installed another 
gyroscope to measure yaw rate. The GPS and the 
gyroscope are the necessary sensors for the purpose of 
control. We show the specifications of the boat and 
sensors in Table 3 and Table 4 respectively. 




Figure 10. The boat in the sea 



In implementing the control algorithm, we take 
advantage of the existing remote control infrastructure. 
The control computer takes the role of a human operator. 
It receives sensor data from boat, executes the control 
law and sends the rudder command to the boat. The 
computer we used is a Pentium III laptop with 256 MB 
RAM. The operating system is Windows XP. 



Table 3 Specification of the boat 



Item 


Description 


Length 


1060 mm 


Width 


250 mm 


Mass 


12 kg 


Propelling Source 


DC motor 


Endurance 


60 minutes 


Maximum Speed 


1.2 m/s 



Table 4 Sensor Specifications 



Sensor 


Specifications 


GPS 


• Position accuracy: 15m (2dRMS) 

• Velocity accuracy: 0.04 m/s in 
magnitude; 0.14 degree in angle 

• Position resolution: 0.001’ (1.8 m) 

• Velocity resolution in magnitude: 
0.1 m/s 

• Velocity resolution in angle: 0.1° 

• Update rate: 1Hz 


Gyroscope 


• Gyro nonlinearity: 0.2% 

• Gyro bias stability: 0.77s 



5. Experimental Results 

The designed controller is tested through sea trials to 
evaluate the performance. We present the experimental 
results of following straight line connected course 
specified by waypoints. The first case is a square course 



with lateral length of 100m. The boat’s trajectory, its 
moving direction and the off course distance are shown 
in Figures 11,12 and 13 respectively. Another test case is 
to follow a hexagon with equal side length of 50m. The 
corresponding results are shown in Figures 14, 15 and 16. 




Figure 1 1 . Trajectory of the boat following a square. The red line shows 
the reference trajectory and the blue line indicates the actual trajectory 




Figure 12. The boat’s moving direction and the reference course angle. 
The blue line shows the reference course angle and the green one show 
the boat’s actual moving direction. 




Figure 13. The off course error in the square course following case 

In both cases, the boat moved in clockwise with the 
starting point at the origin. In Figures 11 and 14, the red 
line is the reference course, and the blue line is the boat’s 
actual trajectory measured by GPS. In the square course 
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case, the boat travelled a 700m distance, and in the 
hexagon course case it went as far as 400m. 
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Figure 14. Trajectory of the boat following a hexagon. The red line 
shows the reference trajectory and the blue line shows the boat’s actual 
trajectory 




Figure 15. Reference course angle and the boat’s moving direction in 
hexagon course case. The reference angle is indicated by blue line and 
the acutal moving direction by green one. 




Figure 16. Off course error in hexagon course following case 



The direction following performance is indicated in 
Figures 12 and 15. We can see that the boat move around 
the reference direction to steer the boat to go on the 
course as near as possible. The off course errors are 
shown in Figure 13 and Figure 16. Except for the time of 
turning, the off course error is less than 2 meters which is 
the least distance that the GPS we used can measure. 



After turning, the off course error decreases as the boat 
approaches to the reference course. The GPS resolution 
issue is evident by the jumps in the data as shown in 
Figures 13 and 16. In Figure 16, the data frozen occurred 
around 100s and 220s may be caused by GPS 
degradation, yet the exact reason is not clear. 

In Figure 17, we show the distribution of off course error. 
This is done on all data including both the square and 
hexagon course cases. It shows that in most of the time, 
the track error lies in between ± 4 meters in the total 
travel of 1.1km. The overall standard deviation of the off 
course error is 2.3m. If we exclude the turning portion, 
the standard deviation is 1.4m. The negative tracking 
error is due to the fact that the boat is following courses 
with clockwise turns. The off course error builds up 
negatively when the boat initiates a clockwise turn. The 
experiments were done in the sea with the wave height of 
about 0.5m. 




Off course error [m] 



Figure 17. Distribution of the off course errors 

In evaluating the performance, we made a rough 
comparison with previous research where experimental 
data were provided. In Table 5 we show the data reported 
in [6, 12, 24]. 



Table 5 A comparison of course keeping performance 



Platform 


Mass 


Position 

By 


Max. 

Error 


Std. 

Error 


Catamaran[12] 


320kg 


DGPS 


1.5m 


* 


Ferry ship [24] 


* 


DGPS 


5m 


3m 


Model boat [6] 


* 


RTK GPS 


lm 


* 


The boat in 
this study 


12kg 


Low cost 
Standalone 
GPS 


2m 


1.4m 



The ‘ * ’ marks mean that the data are not available in the 
sources. DGPS refers Differential GPS and RTK GPS 
means Real Time Kinematic GPS. 



The rough comparison indicates the good performance 
achieved by the proposed approach despite of its light 
weight and less accurate GPS. The performance can be 
improved if we use more expensive GPS with better 
accuracy and faster update rate such as DGPS or RTK 
GPS. 
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6. Conclusion 

In this work, we have designed and verified a course 
following controller for a small boat with low-cost GPS 
and gyroscope. The total sensor cost is less than $100. 
We have derived a simple mathematical model to express 
the dominant dynamics of a boat for course following. 
This model enables us to design controllers without using 
a compass. The model error and environmental 
disturbance are handled by applying robust control theory. 
We use mixed T^/Hoo approach to optimize the course 
following performance measured in H 2 norm while 
maintaining the robust stability in the measure of H^ 
norm. The performance of the designed controller has 
been proved by our sea tests. The overall standard 
deviation of course following error is 2.3m in the total 
1.1 km sea tests. The standard deviation of the course 
keeping error is 1.4m. The experimental data show that 
the integrated modeling and control approach for the 
course following control of the small autonomous boat 
with low cost sensors is robust and effective. 
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Abstract 

Present mobile multimedia networks have different 
Quality of Service (QoS) requirements for diverse 
applications starting from voice to Multi Media Services 
(MMS) with major objectives such as better admission 
control, effective bandwidth utilization, support for real- 
time and non- real time applications content transfer, 
mobility etc. So the network aims at satisfying their 
demands without much degradation of quality in terms of 
delay call dropping and call blocking. It is possible by 
admission control algorithms and by optimizing the 
existing resources in an effective way. It improves the 
overall performance of the network system. 

This paper addresses different Quality of Service (QoS) 
requirements of the users of a cellular network with a 
focus on fuzzy based Call Admission Control Scheme 
(CAC) and optimized bandwidth allocation using Linear 
Programming (LP) analytical model. For comparison, 
Meta heuristic technique- Simulated Annealing (SA) is 
also used. We propose a novel combined framework 
model to address resource allocation problem. This 
problem can be dealt with two critical issues in a cellular 
mobile multimedia networks namely Admission control 
and Transmission control. The admission control - the 
decision to admit or reject the calls based on fuzzy logic 
concepts. Transmission control - Bandwidth allocation 
using LP technique and SA method. We demonstrate the 
efficiency of the proposed framework model by 
combining fuzzy based admission control scheme and 
optimized techniques in bandwidth allocation, which 
provide better QoS differentiation and efficient usage of 
scarce radio resource such as bandwidth in multimedia 
cellular networks. 

Keywords: Call admission control, fuzzy logic, bandwidth 
allocation, linear programming, QoS, simulated 
annealing. 

1. Introduction 

The tremendous growth of mobile network technology has 
increased the need for better admission control strategies 



and efficient utilization of resources such as bandwidth, to 
provide a better Quality of Service (QoS). In particular, 
QoS provisioning in Third Generation (3G) and Fourth 
Generation (4G) mobile networks is a challenging 
problem due to the scarcity of wireless resources and 
different QoS service class requirements. [1-2]. CAC is a 
fundamental mechanism used for QoS provisioning in 
networks. In literature most of the admission control 
algorithms have been dealt with Asynchronous Transfer 
Mode (ATM) networks [3] which are not applicable to 
mobile networks due to its limitations such as scarce radio 
resources, power control etc. The admission control for 
mobile networks based on thresholds were addressed in 
papers [4-5]. Here different admission policies are applied 
to different regions and threshold values separate the 
regions. But determining the values for the thresholds that 
separate those regions is a critical problem. Another AC 
method by the authors of [6] use a decision-theoretic 
approach based on Markov Decision Process (MDP). But 
large number of states in Markov model makes it 
unsuitable for real-life problems. This can be eliminated 
by a fuzzy logic based admission control method that is 
less computationally intense and it also allows embedding 
initial knowledge about the system behavior by means of 
its membership function (MF), antecedents and 
consequence of fuzzy rule. Paper [7] focuses on fuzzy 
CAC that estimates the effective bandwidth of call request 
from mobile station and its mobility information and 
makes a decision to accept or reject connection request 
based on estimation and resource availability. In paper [8] 
the authors addresses the optimal number of guard 
channels in a base station to make an effective use of 
resources. In the recent paper [9] the authors compare 
their algorithm with Shadow Cluster Concept with better 
accepted connections. 

Providing better resource utilization [bandwidth, buffer, 
power] and ensuring QoS 'guarantees to various 
applications are important objectives in next generation 
4G cellular networks. Because it targeted at supporting 
various applications like voice, data, image with enhanced 
data rate, QoS, security, location awareness etc., a number 
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of bandwidth adaptation techniques exist in the literature. 
The papers [10-12] deal with the bandwidth estimation for 
multimedia networks in distributed network environment. 
Levine et al [13] proposed predictive resource allocation, 
which deals shadow cluster concept. The major limitation 
of this method is its large overhead. Priority based AC 
was proposed in [14]. The better utilization of network 
bandwidth using measurements based methodology is 
dealt in [15]. In [16], bandwidth reservation method was 
suggested but it has the drawback of unfair bandwidth 
utilization. Papers [17-19] mainly deal with a much 
complex mathematical model with only minimum 
improvement in the overall performance of cellular 
mobile and adhoc networks. The paper [20] uses a 
proportional fairness in bandwidth allocation so as to 
tolerate transient fluctuations using bandwidth-borrowing 
concept. The paper [23] deals with Linear Programming 
[LP] based resource reduction. 

All the schemes used above deals either with CAC based 
on fuzzy concept or Bandwidth optimization in a mobile 
multimedia networks as a separate issue. But we address 
the two critical issues in cellular networks - Fuzzy 
Classification based Admission Control (AC) - Decision 
to admit or reject calls based on fuzzy rules and resource - 
bandwidth allocation in optimized way by admitting more 
number of applications using LP and SA techniques in a 
novel single framework model. 

We organize the rest of the paper as follows. Section 2 
presents the system and network model of a typical 
cellular system. In section 3 a new combined framework 
for CAC and optimized bandwidth allocation is proposed. 
Section 4 presents optimization using LP method. Section 
5 addresses SA scheme and Section 6 addresses fuzzy AC 
scheme results. In section 7 the results of optimization 
using LP and SA are obtained. Section 8 concludes the 
paper. 

2. Systems and Network Model 

Figure 1 shows a typical multimedia wireless cellular 
network system with hexagonal shaped cells. Each cell 
has a base station (BS), which allocates and reserves 
bandwidth for mobile stations (MS). The MS 
communicate with their home BSs via the air interface 
and a number of BSs are connected to Base Station 
Controllers and finally to a Mobile Switching Center 
(MSC), which in turn is connected to the backbone wire 
line networks. The bandwidth can be shared for 03 types 
of applications namely Running, Hand-off and New 
applications. [23] 

Already scheduled applications of any type are called as 
running applications, while the calls that move from 
adjacent cell to the reference cell are called as hand off 
applications. The new calls from the same reference target 
cell are known as new applications. The design of 
effective CAC should admit calls based on two QoS 



classes: hand off calls and new calls. Here the admission 
is based on real-time or non-real time applications with 
real-time as the higher priority. 




MS: Mobile Station 
BS: Base Station 
RA: Running Application 
NA: New Application 
OA: Hand-off application 
Figure 1 .Cell Network Model 

3. Proposed framework for CAC and 
Bandwidth Allocation: 

The proposed work involves two main modules as shown 
in figure 1: Fuzzy based admission control and 

Transmission control using optimized bandwidth 
Allocation. AC schemes using threshold’s based on 
network load were proposed in [21-22]. The major 
problem of these schemes is the determination of the 
threshold values that divide the bandwidth regions. We 
attempt to define parameter like network load as fuzzy 
linguistic variable with the term low, medium and high. 
The transition from small to medium or from medium to 
high is a region associated with network load. So In the 
first module the inputs are network load and precedence. 
The fuzzy inference- process of composition between 
facts and rules is used. There are nine fuzzy rules defined 
to relate premises and conclusion to make the admission 
decision. Here admission control is used to admit many 
mobile networks with delay as one of the QoS 
performance requirement. Weighted Round Robin (WRR) 
is used since it is a good approximation of the Fluid Fair 
Queuing (FFQ) model and widely used in wireless 
networks. 

The second module focuses on bandwidth allocation for 
various admitted applications with various QoS service 
classes, namely Hand-off real time, new real time, hand- 
off non-real time and new non real time applications. 
Without any optimization scheme, maximum bandwidth is 
allocated to each running or scheduled application. But 
using optimization schemes, bandwidth reduction without 
violating minimum QoS is obtained. The optimized output 
facilitates admission of more number of hand-off and new 
QoS applications into the cell. For comparison LP and SA 
based optimization schemes were used. 
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Figure 2. Proposed Framework of AC and Bandwidth 
Optimization 

3.1. Fuzzy logic System 

In set theory, if an object is an element of a set then its 
characteristic function is 1. Otherwise, its characteristic 
function is 0. It does not allow for partial membership 
called crisp set. 

Input H(x)= ! 1 x C A 

l 0 x € A 

The degree of membership in a fuzzy set, an object may 
belong partially to a set. In a fuzzy set the degree of 
membership is measured by generalization of the 
characteristic function called the membership function 
[24]. The basic building block of of a typical fuzzy system 
is shown in figure 3. 




Figure. 3 Block Diagram of fuzzy system 



Pa(x): X — > [0,1] 

A fuzzy rule can be expressed in the form “if premise 
then conclusion ”, where the premise can be simple or 
composed, If composed, it can be expressed in the form of 

Premise = premise i AND premise2 OR 
. . . Premise n , 

Where the logical operators AND, OR, NOT can be used 
for composition [25]. In our case, we use AND operators. 



3.2. Weighted Round Robin - Time delay 
For Call Admission Control, Fuzzy Logic Controller is 
used. It is based on papers [25-26]. The linguistic 
variables in premises are network load and mobile nodes 
precedence. Network load is defined as the number of 
active nodes at a time period in a cell. Mobile node 
request precedence is weight or priorities given based on 
the type of request. [24-25] For example, handoff requests 
are given more priorities than new call request since 
dropping of a call during handoff is more vulnerable than 
blocking of new call. Both network load and precedence 
are having the terms low (L), medium (M) and high (H), 
while linguistic variable in conclusion is admission 
decision, with the term defined by Strong Accept (SA), 
Weak Accept (WA), Strong Reject (SR) and Weak Reject 
(WR). The delay for each QoS class is proportional to 
network load. The QoS requirement of the mobile nodes 
is met with Weighted Round Robin (WRR) scheme [26]. 

In the routers having multiple queues for each output line, 
(one for each source), When a line becomes idle the router 
scans the queue in a round robin fashion. It gives all hosts 
the same priority. But in many situations in multimedia 
networks it is desirable to give different QoS. For this 
WRR is chosen, since it is a very good approximation of 
fair queuing. The sending delay experienced by Mobile 
Node (MNi) is given by following expression. 

Sending delay = FL Si (KiWi) / B a v r .Wi cntr-cycle 
Network load = X Ki.Wi/B avr 

Where sending delay is the time necessary to transfer a 
file of length FL, from a MNj belonging to the QoS class i. 
While Wi is the weight assigned to a MN from class i. The 
sum is obtained from all MNs that are active. B avr is the 
average number of channels allocated for mobile networks 
and center cycle is 20ms. The WRR algorithm with 
sending delay experienced by MN j for our problem is 
given below: 

// Calculation of sending delay in sending a file length 
belonging to specified class// 

for {each connection} 

{ 

min = fmdSmallestNormalizedWeight(); 
load[i] = number of active mobilei]. weight of the 
call[i]/min 

SendingDelay[i]= 

F ileLength. sum(load[i]/AvgN oChannels; 

i++ 

} 

for {each connection} 

sending delay < QoS TimeLimit 
acccept call 
else 

reject call 

// call dropping and call blocking are determined by the 
type of call request // 

The following table I shows the nine rules used to 
implement fuzzy AC algorithm. In the Fuzzy Logic 
Controller, as discussed previously, the network load and 
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the mobile node precedence are used as inputs and output 
is the admission decision for the new user. Figure 4 shows 
linguistic terms Low, Medium and High in premises with 
m=63. Figure 5 shows the parameters bl, b2, b3 and b4, 
having the value as bl=8 (SR), b2=24(WR), b3=40(WA) 
and b4=56(SA). For an FLC output of less than m/2 the 
user will be rejected and greater than m/2 the user will be 
admitted. The FLC used in this paper is based on [25]. 



Table 1 . The fuzzy rules 







MNs precedence 






L 


M 


H 




L 


WA 


SA 


SA 


Network Load 


M 


WR 


WA 


SA 




H 


SR 


WR 


WA 



Membership function-Premies 




Figure 4: The Fuzzy terms in premises (Network load and MNS 
precedence) 




Figure 5. Fuzzy conclusion (Admission decision) 

In our fuzzy approach the purpose of AC scheme is to 
admit many mobile nodes with varying QoS classes. 

CLASS 1 (Hand-off real time Applications) - Cl 

This traffic class deals with calls arrival from 
neighboring cells in real-time. It includes Voice Service, 
Audio Phone, Video Phone, and Video Conference. These 
are Constant Bit Rate (CBR) services. A very high value 
of weights is assigned. 

CLASS 2 (New real time Applications) - C2 



This traffic class is calls arrival within the target cell in 
real-time. It also includes Audio Phone Video Conference 
services. Moderate value of weights is assigned. 

CLASS 3 (Hand-off non- real time Applications) - C3 

This traffic class deals with calls arrival from neighboring 
cells in non real-time. It includes Email, Paging, Fax and 
File Transfer. These are unspecified Bit rare (UBR) 
services of large bandwidth requirement. 

CLASS 4 (New non- real time Applications) - C4 

This traffic class are calls arrival within the target cell in 
non real-time. The weights assigned are little less than 
Class 3 since handoff calls are given higher priority than 
new incoming calls into the cell. 

4. Results - Fuzzy AC Scheme 

The results that are presented here demonstrate the 
capability of fuzzy AC algorithm to maintain the network 
load close to a target value and maintain the transfer 
delays close to a target value for each QoS class. Also 
comparison between fuzzy AC and Non-fiizzy based on 
fixed thresholds is applied. 

The simulation using MATLAB 7.0 for comparison of 
sending delay for 04 classes were shown in figure 6 to 9. 
In simulation the weights used for the QoS classes are as 
follows. For Class 1 it is 1, for class 2 it is 0.7, for class 3 
it is 0.3 and for class 4 it is O.The simulation environment 
is composed of hexagonal cell with six neighboring cells. 
Each cell is allocated with eight channels. The number of 
active mobile nodes is randomly distributed. The time 
delay required for each class of service is calculated using 
WRR queuing model. The sending delay is calculated 
from WRR. And the same is plotted for four service 
classes by comparing it with non-fuzzy model. The fuzzy 
based admission control need not rely on assumptions 
concerning probability density functions of the parameters. 
The sending delay limit for real time traffic class and non 
real time traffic class for both hand-off and real time calls 
are plotted as shown in figures 6 to 9. Figure 10 
represents Sending Average Delay for four traffic classes 
(handoff real time, new real time, handoff non real time, 
new non real time} . 

Class 1 : Hand-off real time calls: 

It is a constant bit rate services with very high QoS in 
terms of minimum delay. It includes audio, video services. 
The sending delay is restricted to 400 ms for real-time call 
requests. The file length assumed for interactive audio and 
video services are 1 -10Kbps. 
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SENDING DELAY FOR CLASS I 




Figure 7: Sending delay of class 1 
Class 2: New real time calls: 

It is a constant bit rate service with very high QoS in 
terms of minimum delay. It includes audio and video 
services. The sending delay is 450 ms and file length is 1- 
10 Kbps. 



SENDING DELAY FOR CLASS II 




Figure 8: Sending delay of class 2 



Class 3: Hand-off non real time calls: 

It is an unspecified bit rate service with dedicated 
reactive flow supports for streaming applications. It 
includes file transfer, audio/video down load services and 
adaptive video. The sending delay is restricted to 4 
seconds for non real time call requests. The file length 
assumed for non real time services are 1-10 Mbps. 



SENDING DELAY FOR CLASS III 




Figure 9: Sending delay of class 3 
Class 4: New non real time calls: 

It is unspecified bit rate services with dedicated reactive 
flow and includes file video/video download services and 



adaptive video. The sending delay is restricted to 6 
seconds for non real time call requests. The file length 
assumed for non real time services are 1-10 Mbps. 




AVERAGE DELAY FOR QOS CLASSES 




Figure 1 1 : Average delay of QoS classes 



PERFORMANCE IN CALL BLOCKING PROBABILITY 




NO OF CALLS 

Figure 12: Performance in Call Blocking Probability using Fuzzy Logic 

The performance of fuzzy AC algorithm is compared with 
non fuzzy AC algorithm based on threshold. The results 
show that in non fuzzy the call blocking probability is 
approximately 0.4 and using fuzzy logic by assigning 
different weights defined according to the traffic classes 
reduces the Call Dropping Probability to 0.23. The 




65 




Automatic Control and System Engineering Journal, ISSN: 1687-4811, Volume 7, Issue 1, ICGST, Delaware, USA, May 2007 



simulation result using fuzzy and non fuzzy approach is 
shown in figure 12 above. 

5. Optimization using LP 

In our problem bandwidth is used as a constraint for 
optimum resource allocation for multimedia mobile 
networks. The optimization algorithm deals with 
formulation of optimization problem and then identifying 
important design variables that can be changed in a 
design. The next task is to formulate objective function 
with minimum or maximum function. The final task is to 
identify some bounding limits for design variables [27]. 
Effective and efficient resource allocation is essential for 
cellular mobile network system that supports various 
applications. The objective of resource allocation is to 
decide how to allocate resources such as bandwidth, 
meeting the QoS requirements for all the applications. In 
general, multimedia connection has several service classes, 
each of which presets a range of feasible QoS levels (e.g., 
data rates). 

The principle used here is mainly devoted to admission 
control by maintaining QoS guarantee to existing 
applications and to increase the percentage of admission 
to real time and non-real time application, using LP based 

resource reduction method. The LP-Resource Reduction 
minimizes the allocated bandwidth of already scheduled 
applications without degradation in QoS. It is helpful in 
obtaining a large quantity of available resources for 
scheduling the remaining hand-off and new applications. 
The LP method [18] for given problem is given as below. 



r 

Maximize ^ C R 



Subject toTR < (1 - C1)(P - 0) 

i 



min alloc 

R . < R < R 

l z i 



R >0,V e[l,r] 

i i 



( 1 ) 

( 2 ) 

(3) 

(4) 



Where R is the decision variable to be solved to 

i 

provide new bandwidth for running applications on 
solving above problem. C Is the weight function 

i 

defined as Q =(Ri max - R, alloc) / (R, max - R, min ). Q is the 
reduction parameter and P is the maximum bandwidth 
and 0 is the remaining bandwidth. Note that each 
running application has different bandwidth requirements. 
The optimized Bandwidth requirement of each application 
is calculated using LP reduction using simplex algorithm. 
To illustrate the proposed approach, the following 
problem is solved for typical running application r=5. 



Where P=300 Kbps, Q =0.1 and © = Remaining 
bandwidth after allocation. This can be explained with the 
following case study using LP. 

Lind (Ri, R 2 R3 R4 R5 ) so as to maximize 

fi= (Ci Ri , C 2 R 2 , c 3 R 3 , c 4 R4, C 5 r 5) . 

Subject to constraints as in equation 3 and 4 above. 

The software TORA is used to solve the problem. The 
individual optimal solution of the 05 running applications 
are (Ri , R 2 , R3 , R4 , R5 ) = ( 40 kbps, 24. 5 kbps, 45 
kbps, 3 5 kbps, 40 kbps) 

Without optimization for 5 running application the total 
bandwidth used is 205 kbps. Using LP based bandwidth 
reduction total bandwidth is 184.5 kbps only. This is 
shown in figure 13. The bandwidth saving of 20.5kbps is 
used for hand-off and new applications with the priority as 
explained above. 




Figure 13: Bandwidth allocation for the typical five applications in LP 



6. Optimization using SA Scheme 

The major limitation of LP method is with its optimization 
for local minima only. The intelligent optimization 
methods will provide better optimal solutions than 
complex mathematical model for a mobile wireless 
networks in a real time environment. But the quality of 
solution in comparison to classical optimization technique 
is often a trade off against computation time and it is 
possible to reach a near optimal solution within bounded 
computation time. Hence we propose an algorithm based 
on SA. The algorithm takes the available constraints 
resources etc and finds an optimal or near optimal solution 
for resource allocation in mobile multimedia networks. 

The fundamental concepts of SA [28] as a solution 
methodology for combinatorial optimization problem are 
considered here. 

The design aspect of SA fundamental has the following 
elements namely, 

a. Set of allowed configuration. 

b. Cost function. 

c. feasibility (Perturbation mechanism) 

d. Cooling schedule. 

e. Acceptance criterion 

In our optimization problem, the feasible solution is 
resource allocation (bandwidth) within bounded values. 
The proposed SA based solution algorithm for our 
problem and results refer author’s paper [29]. The 
proposed SA based solution algorithm for our problem is 
described as below. 
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Step 1: 

Choose an initial point X 




Initial values are 



calculated as the average of (i? mm , R aUoc ) 

In SA temperature T decides the freedom of making 
sufficient number of random moves. Set T a sufficiently 
high value (same for all the applications), number of 
iterations to be performed at a particular T as n , and 
seU = 0 . { t Varies from 0 to fl } .To simulate cooling 
schedule we decrease the value of T after n iterations. 



Step 2: 

At each iteration a neighboring point of the current 
solution is chosen. 

Let x (t) denote the current feasible solution. 

A few feasible solutions in the neighborhood of x (t) are 

chosen and are denoted asx (t+1) , where the range of the 
neighborhood is determined by the parameter T. 

Step 3: 

Using Metropolis algorithm we find out whether the new 
feasible solution is better than the current feasible 
solution. If so we accept the new feasible solution as the 
current feasible solution. 

(7+1) (0 

If A E = E(X )~E(X )<0 

Set t = t + 1 ; (accept the values) 

Else create a random number (r) in range (0,l) 

If r < exp (-AE / T) set t = t + 1 ; 

( accept the values) 

Else go to step 2. 

Step 4: 

If T is very small terminate 

Else if (t == n ) then lower T by a factor of 2 

Then go to step 2 

Else go to step 2 

7. Results - Optimization using LP and SA 

Platform used for experiments are linux and windows 
with PHI processor. For the objective function and 
constraints for various applications LP method is used. 

The same is done using SA technique. The experiments 
are repeated for different input applications and the 
comparison is made. The optimized bandwidth obtained 
using these techniques are again utilized for the hand -off 
and new applications as explained in figure 2. From figure 
14 and 15 it is observed that better results are obtained 
using SA than LP and without LP. 




Figure 14: Bandwidth allocation with and without LP 




Figure 15: Optimized Bandwidth with and without LP and SA 



8. Conclusion and Future Work 

The admission Control Algorithm and Bandwidth 
Allocation for a cellular mobile network using Fuzzy 
logic Controller, LP and SA scheme have been proposed 
respectively. The fuzzy rule based classifier performance 
is good in improving service class classification and 
enhances QoS in admitting calls. The result of the 
comparison between fuzzy and non fuzzy shows that the 
call blocking probability is reduced by 17%. Also the 
resource allocation i.e. bandwidth allocation is efficient in 
LP method when compared to that of the scheme without 
LP. It facilitates more number of applications with better 
QoS in mobile multi media networks. For comparison 
semi heuristic technique-SA also proposed. Further 
improvement is witnessed in this scheme. 

The better AC and resource allocation can be possible 
using computationally efficient and robust tool. For AC 
mobility prediction concepts in terms of Interference 
Guard Margin and for resource optimization heuristic 
based techniques such as Genetic Algorithm (GA) and 
Particle Swarm Optimization( PSO) will be considered in 
future for better solutions. 
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